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coding  techniques  can  then  be  used  to  allocate  the  available  bandwidth  to  the 
significant  spatial  information.  A number  of  transforms  such  as  the  Hada- 
mard,  Fourier,  Haar,  Cosine  and  Slant  could  be  used.  Until  recently,  how- 
ever, the  real  time  realizations  of  these  transformations  were  questionable. 
The  use  of  large  numbers  of  logic,  memory,  and  linear  devices  would  be 
required  to  process  the  video  signal  in  a conventional  manner.  Charge- 
injection  device  technology  can  be  used  to  combine  such  widely  diverse  func- 
tions as  imaging,  memory,  and  signal  processing  into  a single  device  to 
achieve  low  system  cost,  size,  weight,  and  power  consumption. 

The  process  of  computing  the  Hadamard  treinsform  requires  linear  com- 
binations, sums  and  differences,  of  the  picture  information.  This  process 
can  be  easily  mechanized  on  the  focal  plane  of  a CID  image  sensor  by  sensing 
combinations  of  the  signal  charge  from  a number  of  image  sensing  sites 
(pixels)  rather  than  the  individual  pixel  magnitudes. 

This  two-part  program  consisted  of  a design  study,  in  which  array 
parameters  and  array /systems  interface  were  specified,  and  of  a fabrica- 
tion and  evaluation  phase.  The  resulting  video  sensor  is  a charge  injection 
device  (CID)  solid  state  imager  which  can  be  operated  in  two  modes.  In 
one  mode  the  output  is  a conventional  video  signal.  In  the  second  mode  the 
same  chip  is  operated  in  such  a manner  that  the  signal  output  is  the  Hada- 
mard transform  of  the  optical  image.  This  result  is  made  possible  because 
of  the  non- destructive  readout  (NDRO)  capability  of  the  CID,  along  with  its 
ability  to  perform  repeated  algebraic  summations  of  the  photon- generated 
charge  packets  without  signal  mixing. 

The  imager  consists  of  a 128  x 128  array  of  30  micron  square  sensing 
sites.  The  significant  performance  factors  are  a d3Tiamic  range  of  500-to-l, 
dark  current  density  of  1 nA/cm^,  high  quantum  efficiency  (45^  @.66|j),  and 
a very  narrow  point  spread  function.  The  imager  is  capable  of  producing 
four  1x4  Hadamard  transforms  in  parallel,  which  are  then  summed  to 
produce  a 4 x 4 area  transform  of  each  sub -picture. 

The  feasibility  of  real-time  transform  coding  of  an  optical  image 
directly  on  a CID  imager  has  been  conclusively  demonstrated. 
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1.0  INTRODUCTION 


This  final  report  describes  the  General  Electric  Company's  efforts  on  a 
twelve-month  program  for  the  development  of  a CID  imager  capable  of  per- 
forming signal  processing  functions  in  addition  to  the  imaging  function. 
Specifically,  this  CID  imager  produces  directly  a Hadamard  transform  of  an 
incident  optical  image  and,  in  addition,  is  capable  of  producing  a normal 
video  signal,  when  operated  in  a second  mode. 

This  two-part  program  consisted  of  a design  study,  in  which  array  param 
eters  and  array /systems  interface  were  specified,  and  of  a fabrication  and 
evaluation  phase.  The  design  study  phase  was  performed,  in  large  part,  by 
the  Aerospace  Electronic  Systems  Product  Department,  Utica,  New  York; 
while  the  remainder  of  the  work  was  carried  out  at  Corporate  Research  and 
Development,  Schenectady,  New  York, 

The  design  study  indicated  that  a simple,  high-density  array  would  be 
effective  both  as  a normal  imaging  device  and  for  Hadamard  transform  read- 
out. It  was  possible  to  increase  the  number  of  array  elements  from  64  x 64 
to  128  X 128,  with  performance  goals  unchanged,  within  the  resources  of  the 
original  contract.  The  performance  achieved  with  the  larger  array  demon- 
strates that  this  was  a proper  decision.  This  program  has  demonstrated 
that  focal-plane  signal  processing  can  be  effective,  and  high  performance 
achieved,  in  high-density,  high  quantum  efficiency  solid-state  CID  imagers. 
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2.0  STUDY  RESULTS 

2.  1 PURPOSE  AND  OBJECTIVE  OF  DESIGN  STUDY 

The  overall  objective  of  the  design  phase  was  to  specify  the  CID  focal  plane 
processor  chip  design  parameters  based  upon  overall  system  performance 
and  chip  design  complexity.  To  satisfy  this  objective,  the  study  was  con- 
ducted in  two  parts.  The  first  part  was  directed  at  determining  the  interface 
requirements  between  the  CID  chip  and  a generic  system  based  on  optimum 
system  performance.  This  effort  included  a comparison  of  one-,  two-, 
and  three-dimensional  transform  encoding,  the  effect  of  block  size  on  system 
performance  and  hardware  complexity,  and  methods  of  performing  the  inverse. 

The  second  part  of  the  study  consisted  of  an  investigation  of  the  various 
Hadamard  transform  encoding  techniques  and  transform  sizes  with  respect 
to  CID  chip  complexity,  manufacturability,  and  performance  as  a conventional 
imager, 

2.  2 PROBLEM  DESCRIPTION 

The  CID  focal  plane  processor  is  a low  power,  small  size,  bandwidth  com- 
pression implementation  approach  suitable  to  mini-RPV  applications.  Prior 
to  discussing  the  CID  implementation  a brief  description  of  the  jam  resistant 
video  data  link  problem  is  given. 

The  transmission  of  video  data  from  an  RPV  to  a distant  observer  re- 
quires a large  bandwidth  channel  in  order  to  protect  the  video  information 
against  jamming  and  interference.  This  protection  can  be  achieved  by  Spread 
Spectrum  techniques,  whereby  the  information  bandwidth  is  spread  and  trans- 
mitted over  a wideband  signalling  structure  and  received  in  a correlation  type 
receiver.  In  many  applications,  however,  the  available  channel  bandwidth 
is  barely  sufficient  or  is  insufficient  to  transmit  the  video  signal  directly. 

In  these  cases  the  video  information  can  be  transmitted  only  after  the  redun- 
dancy present  in  the  original  image  is  greatly  reduced.  Transform  encoding 
or  block  quantization  has  become  a leading  candidate  for  removing  redundancy 
in  images.  The  underlying  principle  of  transform  encoding  is  that  the  trans- 
form domain  representation  of  an  image  has  an  energy  distribution  that  is 
more  compact  and  therefore  easier  to  code  than  the  spatial  domain  version. 
This  technique  has  been  shown,  via  software  simulation,  to  be  capable  of  pro- 
viding adequate  bandwidth  compression  but  requires  complex  signal  process- 
ing. Efforts  directed  at  hardware  implementation  of  these  complex  algorithms 
within  the  severe  RPV  size  requirement  have  met  with  little  success. 

Shown  in  Figure  2-1  is  a functional  block  diagram  of  a generic  jam  re- 
sistant video  data  link.  The  system  consists  of  an  encoder  located  in  the 
RPV  and  a decoder  located  in  a control  aircraft  or  at  a ground  station.  The 
encoder  consists  of  a camera,  bandwidth  compression  module,  and  a spread 
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Figure  2-1.  Generic  Jam  Resistant  Video  Data  Link 


spectrum  modulator.  The  decoder  consists  of  the  corresponding  spread 
spectrum  demodulator,  an  inverse  bandwidth  compression  module,  a video 
refresh  memory,  and  a video  monitor.  The  bandwidth  compression  or  trans- 
form encoding  module  consists  of  a Hadamard  transform  processor  and  a 
quantizer  which  is  responsible  for  assigning  more  bits  to  the  important  co- 
efficients and  fewer  bits  to  the  less  important  coefficients.  The  compressed 
digital  data  is  then  transmitted  via  a spread  spectrum  modem  implemented 
using  a direct  pseudorandom  noise  sequence  for  frequency  hopping  or  chirp 
techniques.  The  inverse  bandwidth  compression  module  decodes,  expands 
and  performs  an  inverse  Hadamard  transform  to  reconstruct  the  compressed 
video  signal  to  form  a replica  of  the  original  video  signal.  A frame  store 
memory  is  generally  required  at  the  decoder  because  the  picture  is  processed 
in  small  blocks  and  to  avoid  display  flicker  during  operational  modes  which 
require  frame  rate  reduction.  These  operational  modes  include  the  standard 
30  frames /sec  for  operation  in  a clear  environment,  selectable  reduced 
frame  rates  2,  4,  and  8 frames  per  second,  and  snap  shot  mode  for  operation 
in  heavy  jamming. 

2,  3 SUMMARY  OF  RESULTS 

2.  3,  1 Baseline  Jam  Resistant  Video  Data  Transmission  System 

The  CID  focal  plane  processor  approach  offers  the  opportunity  to  relieve 
the  size,  weight,  cost  and  power  limitations  imposed  by  the  mini-RPV  ap- 
plications. This  is  accomplished  by  performing  the  transform  processor 
function  of  the  transform  encoder  directly  on  the  image  plane.  As  discussed 
in  a later  section,  the  focal  plane  processor  can  be  used  to  implement  one- 
and  two-dimensional  transform  processor  algorithms  resulting  in  a signifi- 
cant simplification  in  two-  and  three-dimensional  bandwidth  compression 
systems.  The  most  dramatic  impact  in  terms  of  transform  processor  hard- 
ware savings  and  overall  systems  performance  is  realized  in  the  implementation 
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of  a hybrid  interframe  encoding  algorithm.  In  this  approach,  a two-dimen- 
sional Hadamard  transform  is  used  to  remove  the  spatial  redundancy  within 
a single  frame  while  frame-to-frame  redundancy  is  removed  via  a predictive 
coding  technique,  namely  Differential  Pulse  Code  Modulation  (DPCM). 

A functional  block  diagram  of  the  system  is  shown  in  Figure  2-2.  Oper- 
ationally, the  picture  is  processed  in  4 x 4 subblocks.  A two-dimensional 
Hadamard  transformation  is  performed  on  each  of  the  subblocks  in  the  image 
plane  and  each  of  the  16  transform  coefficients  is  encoded  in  the  temporal 
direction  by  a bank  of  digital  DPCM  encoders.  The  encoded  frame-to-frame 
transform  coefficient  differences  are  transmitted  to  the  ground  station  or 
control  aircraft  over  the  wideband  data  link.  At  the  receiver,  each  quantized 
transform  coefficient  is  combined  with  its  predicted  value  to  give  its  recon- 
structed value.  The  16  reconstructed  transform  coefficients  corresponding 
to  a particular  4x4  subblock  are  then  sent  to  a digital  inverse  Hadamard 
transform  processor.  Since  all  of  the  transform  coefficients  are  available 
and  since  the  Hadamard  transform  is  its  own  inverse,  the  inverse  transform 
processor  is  simply  a 16  point  one-dimensional  Hadamard  transform  which 
is  implemented  using  standard  "fast"  transform  algorithms  similar  to  the 
FFT. 
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Figure  2-2.  Baseline  Jam  Resistant  Video  Data  Link 
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The  CID  imager /transform  signal  processor  and  inverse  Hadamard  trans- 
form implementations  are  of  particular  significance  to  this  study.  The  re- 
mainder of  this  section  is  directed  at  summarizing  these  implementations. 

2.3.2  CID  Transform  Processor  Implementation 

Shown  in  Figure  2-3  are  the  16  Hadamard  patterns  that  would  be  applied 
to  a 4 X 4 subblock  of  pixels.  The  appropriate  coefficients  are  the  sum  of 
the  applied  positive  and  negative  weighting  on  the  intensity  at  each  pixel.  As- 
suming familiarity  with  the  basic  operation  of  the  CID  imager  and  the  charge 
summation  principle,  an  operational  sequence  for  generating  the  16  transform 
coefficients  is  as  follows:  a Hadamard  code  generator  output  is  such  that  the 
array  columns  are  driven  so  as  to  result  in  the  application  of  pattern  Gqo  to 
a particular  4x4  subblock  of  pixels.  That  is,  columns  1 through  4 are 
driven  so  as  to  result  in  a positive  contribution  at  each  row  output.  The  sum 
of  the  row  1,  2,  3 and  4 outputs  gives  the  Gqo  Hadamard  coefficient. 


Notice  that  with  no  change  in  the  column  drive  potentials,  Gqi  can  be  de- 
termined directly  simply  by  subtracting  the  sum  of  the  outputs  from  rows  1 
and  2 from  the  sum  of  rows  3 and  4.  A similar  observation  can  be  made 
concerning  coefficients  G02  and  G03.  The  array  column  potentials  are  then 
driven  so  as  to  result  in  the  application  of  pattern  Gio  to  the  4x4  subblock 
of  pixels.  This  pattern  is  used  to  generate  coefficients  Gn,  G12,  and  G13. 

In  a similar  manner,  patterns  G20  and  G30  are  used  to  generate  the  remain- 
ing 8 Hadamard  transform  coefficients. 
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Figure  2-3.  Two-dimensional  Hadamard  Patterns  as  Applied  to  a 4 x 4 
Subblock  of  Pixels 


Although  the  4x4  Hadamard  transform  can  be  accomplished  completely 
on  a single  CID  focal  plane  processor  chip,  hardware  implementation  consid- 
erations indicate  that  it  can  best  be  done  by  designing  the  imager  to  provide 
four  1x4  transforms  in  parallel  with  the  final  row  summation  done  digitally 
after  A/D  conversion.  This  issue  is  discussed  in  detail  in  a later  section 
but  this  decision  is  based  primarily  on  the  following: 

• A reduction  in  the  A/D  converter  speed  requirement  allows  compati- 
bility with  low  cost  IC  circuitry. 

• A reduction  in  the  dynamic  range  requirement  for  the  CID  output  am- 
plifier. 

An  implementation  of  this  approach  is  illustrated  in  Figures  2-4  and  2-5. 
The  appropriate  4x4  pixel  subblock  is  selected  by  selecting  a particular  set 
of  four  columns  and  four  rows  via  the  ROW  SELECT  and  COLUMN  SELECT 
logic.  The  column  drive  potentials  are  applied  at  the  four  inputs  to  give  to  the 
Goo  Hadamard  pattern.  The  sum  of  the  four  pixel  values  of  row  1 of  the  sub- 
block is  available  at  output  pad  A,  of  row  2 at  B,  row  3 at  C and  row  4 at  D. 
These  four  outputs  are  all  that  is  necessary  to  generate  the  four  Hadamard 
coefficients.  Goo,  Goi,  G02,  and  G03.  This  off- chip  summation  is  illustrated 
in  Figure  2-5.  Notice  that  the  four  coefficients  are  stored  in  a digital  mem- 
ory. The  reason  for  this  will  be  discussed  shortly. 

Next  the  column  drive  potentials  for  the  selected  subblock  are  driven 
to  give  the  Gio  pattern.  The  four  row  outputs  are  summed  off  chip  in  the 
same  manner  and  stored.  The  process  is  repeated  for  the  G20  and  G30 
patterns.  At  the  completion  of  this  sequence  the  16  Hadamard  coefficients 
are  stored  as  indicated  in  Figure  2-5. 

The  coefficients  are  stored  because  they  contain  pattern  noise.  This 
noise  is  removed  by  injecting  the  4x4  pixel  block,  regenerating  all  16  co- 
efficients in  the  identical  manner  in  which  the  stored  values  are  generated, 
and  subtracting  out  the  pattern  noise.  This  technique  is  referred  to  later 
as  "block  injection." 

In  summary,  the  CID  focal  plane  processor  implementation  of  a two- 
dimensional  4x4  Hadamard  transform  processor  has  the  following  desirable 
features: 

• Significant  simplification  in  two-dimensional  transform  processor  im- 
plementation. 

• Simple  Hadamard  code  generation  since  only  four  codes  are  necessary 
to  generate  all  16  transform  coefficients. 

• Easing  of  dynamic  range  requirements  for  the  sense  channels. 

• Four-to  one  reduction  in  A/D  converter  speed  requirement  is  compat- 
ible with  low  cost  IC  devices. 
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• Compatibility  with  interframe  coding  systems. 


I !r 


A variation  of  the  above  approach,  described  in  detail  in  a later  section, 
would  permit  the  generation  of  an  8 x 8 block  transformation  from  four  1x8 
outputs.  This  would  provide  more  processing  gain,  and  near  ideal  theoretical 
coding  performance  at  some  cost  in  array  and  off-chip  processing  complex- 
ity. 


2.  3.  3 Inverse  Hadamard  Transform  Implementation 


Several  approaches  for  performing  the  inverse  Hadamard  transform 
were  considered  during  the  study.  A trade-off  of  the  digital  implementation 
shown  in  Figure  2-6  and  implementations  using  the  General  Electric  pro- 
prietary SCT  correlator  and  matrix  multiplier  devices  clearly  indicate  that 
the  digital  approach  is  superior  for  this  application  where  the  size  require- 
ment of  the  decoder  is  not  severe.  The  selection  of  this  approach  is  based 
primarily  on  the  fact  that  the  data  is  already  digital  at  the  input  to  the  in- 
verse transform  processor.  In  addition,  all  of  the  coefficient  data  is  avail- 
able for  processing  and  two-dimensional  transforms  can  be  implemented 
as  extended  one-dimensional  transforms. 


Figure  2-6.  Inverse  4x4  Hadamard  Transform  Flow  Diagram 


The  architecture  shown  in  Figure  2-6  is  an  iterative  implementation 
based  upon  a fast  algorithm  which  gives  identical  stage-to-stage  geometry. 
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This  results  in  a hardware  savings  in  that  the  hardware  can  be  reduced  to  a 
single  stage  with  feedback.  Thus,  the  desired  inverse  transformation  is 
accomplished  after  the  Hadamard  coefficient  data  is  fed  back  four  times  to  the 
input  via  the  input  multiplexer.  Every  fourth  cycle  the  new  transform  data 
is  entered  through  the  input  multiplexer.  This  data,  in  turn,  is  cycled  four 
times  during  which  time  the  previous  block  of  pixel  values  are  read  into  the 
frame  store  memory.  The  transform  coefficients,  Gjj,  must  be  scrambled, 
as  shown  in  Figure  2-6,  prior  to  processing  to  take  into  account  the  order  in 
which  they  are  generated  by  the  focal  plane  processor. 


! 

I 


I 


I 


2.4.0  BACKGROUND 


Prior  to  discussing  implementation,  it  is  appropriate  to  discuss  the  over- 
all system  problem  to  which  the  CID  focal  plane  processor  is  being  applied. 

A single  set  of  system  requirements  does  not  exist  at  this  time,  making  exact 
systems  evaluation  and  trade-offs  difficult.  This  section  attempts  to  view 
the  jam  resistant  video  data  link  problem  as  applied  to  mini-RPV  applications 
by  describing  the  need  for  video  bandwidth  compression,  briefly  reviewing 
bandwidth  compression  techniques,  and  defining  a baseline  generic  jam  resis- 
tant video  data  link  system.  In  addition  to  providing  the  background  necessary 
to  better  understand  what  the  CID  focal  plane  processor  is  intended  to  accom- 
plish, the  subject  matter  contained  in  this  section  is  the  basis  on  which  later 
sections  are  developed. 


2.  4.  1 Problem  Description 


Jamming  margin  or  jam  resistance  is  the  system  parameter  which  char- 
acterizes the  ability  of  a system  to  operate  in  a jamming  environment.  This 
parameter  can  be  expressed  as 


Mj  ~ Gp  - [Ls  + (S/N)out] 


where 

Mj  = Jamming  margin  or  interference  level 
above  signal  at  which  the  system  will 
continue  to  operate,  i.  e. , jam  resis- 
tance 

Gp  = Processing  gain  or  signal-to-noise 
ratio  improvement  as  a resxilt  of 
modem  processing 

Ls  = System  implementation  losses 
(S/N)^^,^  = Output  information  signal-to-noise-ratio 

The  ability  of  a system  to  resist  enemy  jam.ming,  therefore,  is  related  to 
processing  gain  which  can  be  approximated  by  the  ratio  of  RF  bandwidth  to 
information  data  rate.  Thus,  as  illustrated  in  Figure  2-7,  the  task  of  the 
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Figure  2-7.  Jam  Resistance  Function  of  Airborne 
Encoder 


mini-RPV  encoder  is  to  reduce  the  video  bandwidth  via  image  redundancy  re- 
duction techniques  and  then,  using  Spread  Spectrum  techniques,  expand  the 
compressed  video  signal  over  a wide  transmitted  bandwidth.  The  significance 
of  bandwidth  compression  to  video  data  transmission  in  a jamming  environ- 
ment is  best  illustrated  by  example.  Consider  a 256  line  30  frame /sec  video 
signal  that  has  been  digitized  to  6 bits  per  picture  element  (pixel),  256  pixels/ 
line.  The  resultant  video  data  rate  is  approximately  12  M bits /sec.  Assum- 
ing 20  dB  processing  gain  is  required  to  achieve  a desired  level  of  jam  re- 
sistance, a transmitted  channel  bandwidth  of  1.2  GHz  is  required.  In  light 
of  the  fact  that  the  only  currently  available  modem  for  RPV  applications  has 
a bandwidth  of  20  MHz,  the  256  X 256  image  has  little  chance  of  surviving 
enemy  jamming. 

An  alternative  is  to  reduce  the  bandw’dth  of  the  video  by  removing  the 
natural  redvmdancy  in  the  image  prior  to  transmission.  The  compressed 
video  can  then  be  recoded  to  fill  in  the  allocated  channel  bandwidth.  Com- 
puter simulations  performed  at  the  University  of  Southern  California  have 
shown  that  transform  encoding,  a bandwidth  compression  technique  to  be  de- 
scribed in  the  next  section,  and  frame  rate  control  can  be  used  to  reduce  the  ^ 
television  bit  rate  to  approximately  200  K bits /sec  with  only  slight  picture 
degradation.  Spreading  the  compressed  data  over  a 20  megabit  per  second 
channel  provides  the  desired  20  dB  processing  gain. 

The  fimctional  block  diagram  of  a generic  jam  resistant  video  data  link 
is  shown  in  Figure  2-8.  This  system  consists  of  an  encoder  located  in  the 
RPV  and  a decoder  located  in  a control  aircraft  or  at  a ground  station.  The 
airborne  encoder,  consisting  of  a camera,  a bandwidth  compression  modvile, 
and  a spread  spectrum  modulator,  is  designed  to  provide  the  observer  with 
the  capability  of  varying  the  ratio  of  transmitted  bandwidth  to  video  informa- 
tion data  rate  as  a function  of  jamming  environment.  The  decoder  consists 
of  a spread  spectrum  demodulator,  inverse  bandwidth  compression  module, 
video  refresh  memory  and  a display.  The  function  of  the  decoder  is  to  de- 
code the  compressed  transform  domain  video  data,  perform  the  inverse 
Hadamard  transform  and  buffer  the  reconstructed  video  data  so  as  to  make 
it  suitable  for  display. 
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Figure  2-8.  Generic  Jam  Resistant  Video  Data  Link  System 
2.4.2  Bandwidth  Reduction  Techniques 

As  described  previously,  in  the  design  of  image  coding  systems  for 
digital  communications  channels,  the  primary  objective  is  to  minimize  the 
number  of  code  bits  required  to  reconstruct  the  image  at  the  receiver. 
Efficient  coding  of  the  digital  image  is  accomplished  by  removal  of  statistical 
redvmdancies  that  exist  within  the  image.  Transform,  predictive,  and  hybrid 
transform /predictive  image  coding  techniques  have  been  developed  to  exploit 
intraframe  spatial  image  redundancies. 

2.  4.  2.  1 Transform  Image  Coding.  The  basic  premise  of  transform  image 
coding  or  block  quantization  is  that  the  transform  domain  representation  of 
an  image  has  an  energy  distribution  that  is  more  compact  and  therefore  easier 
to  efficiently  code  than  the  spacial  domain  version.  Block  quantization  for 
picture  data  is  often  viewed  as  coding  in  the  "frequency"  domain.  Since  the 
picture  data  is  largely  low  frequency,  it  does  not  utilize  the  total  bandwidth 
allotted  to  it  by  resolution  requirements  most  of  the  time.  Thus,  in  the 
"frequency"  domain  the  important  components  can  be  coded  and  the  unimpor- 
tant ignored  or  assigned  fewer  bits.  The  trivial  example  is  that  of  a constant 
gray  level  which  needs  only  one  "frequency"  domain  component  (DC  compon- 
ent), while  in  the  "image"  domain  it  needs  whatever  the  block  length  is. 

This  does  not  imply,  however,  that  elimination  of  the  high  frequency  com- 
ponents is  the  proper  choice  of  coding,  since  the  human  eye  is  more  sensitive 
to  the  high  frequency  components.  The  eyes'  fidelity  criteria  give  these  em- 
pirical observations  a higher  weight  than  would  be  given  if  only  the  standard 
deviation  were  considered.  Since  the  image  data  is  two-dimensional,  there 
is  correlation  between  lines  as  well  as  elements  of  one  line.  Therefore,  the 
block  quantization  techniques  can  be  utilized  in  two  possible  ways  (Figure  2-9), 
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Figure  2-9.  Video  Block  Quantization 


that  is,  one-  or  two-dimensional  blocks.  Area  transformations  are  attrac- 
tive because  they  exploit  correlation  in  both  the  horizontal  and  vertical  di- 
rections but  are  disadvantageous  in  that  they  are  difficult  to  implement. 

In  summary,  then,  in  transform  encoding  systems  a one-  or  two-dimen- 
sional linear  transform  of  an  image  block  is  performed  at  the  coder.  The 
transform  coefficients  are  quantized  and  coded  in  accordance  with  a prede- 
termined bit  assignment  and  transmitted.  After  decoding  at  the  receiver,  an 
inverse  transform  is  taken  to  obtain  a reconstructed  image.  Transforms 
that  have  proven  useful  for  this  application  include  Fourier,  Cosine,  Hadamard, 
Slant  and  Karhunen-Loeve.  Simulation  results  indicate  that  a bit  rate  re- 
duction to  1.  5 bits/pixel  can  be  obtained  with  minimal  image  degradation,  t 
The  bit  rate  can  be  reduced  further  by  making  the  transform  coding  system 
adaptive. 

2.4.  2.2  Predictive  Image  Coding.  In  a differential  pulse  code  modulation 
(DPCM)  system,  a prediction  of  each  pixel  is  subtracted  from  its  actual 
value  and  this  difference  is  quantized  and  transmitted.  The  prediction  of  a 
data  point  is  based  upon  a number  of  adjacent  previously  scanned  pixel  sam- 
ples. DPCM  works  because  the  differential  signal  exhibits  a significant  re- 
duction in  variance  as  compared  to  the  variance  of  the  original  samples. 
Quantization  of  the  data  is  done  with  a quantizer  designed  for  the  probability 
density  of  the  difference  signal,  making  its  performance  sensitive  to  the 
statistics  of  the  source. 

Thus,  the  basic  operation  of  the  DPCM  encoder  is  to  generate  an  uncor- 
related signal  which  is  then  encoded  by  a memoryless  quantizer  for  trans- 
mission. At  the  receiver,  the  quantized  difference  signal  is  combined  with 
its  predicted  value  to  form  the  reconstructed  pixel  value.  Basic  DPCM  image 


fW.  K.  Pratt,  "Spatial  Transform  Coding  of  Color  Images,"  IEEE  Transactions 
on  Communication  Technology,  Vol.  COM-19,  No.  6,  December  1971, 
pp.  980-992. 
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coding  systems  provide  good  quality  at  about  3 bits/pixel.  Adaptive  systems 
in  which  parameters  of  the  quantizer  and  predictor  adapt  to  image  content  re- 
quire about  2 bits /pixel. 

2.  4.  2.  3 Hybrid  Image  Codingt  t.  Both  DPCM  and  transform  coding  techniques 
have  been  shown  to  exhibit  some  attractive  characteristics  and  some  limita- 
tions. Advantages  of  transform  encoding  system  over  DPCM  coders  include: 

• Superior  coding  performance  at  lower  bit  rates. 

• Coding  degradation  distributed  in  a manner  less  objectionable  to  a 
human  observer. 

• Less  sensitivity  to  data  statistics  (picture -to -picture  variation). 

• Less  vulnerability  to  channel  noise. 

On  the  other  hand,  DPCM  systems: 

• Achieve  better  coding  performance  at  higher  bit  rates. 

• Require  less  complex  coding  hardware. 

• Produce  a minimal  coding  delay. 

• Do  not  require  a large  block  memory. 

Hybrid  coding  systems  that  combine  the  attractive  features  of  transform  en- 
coding and  DPCM  have  been  investigated.  Two  hybrid  systems  have  surfaced 
as  a result  of  these  studies.  The  first  approach  is  directed  at  avoiding  the 
block  memory  requirement  of  two-dimensional  transform  encoders  while  still 
retaining  its  attractive  features.  The  hybrid  encoder  consists  of  a transform 
encoder  in  series  with  a DPCM  filter  bank.  In  this  system  a one-dimensional 
transform  in  the  horizontal  direction  is  followed  by  line-to-line  DPCM  coding 
of  the  transform  coefficients.  At  the  receiver,  the  transform  coefficients  are 
decoded  and  a replica  of  the  original  video  signal  is  reconstructed  by  an  in- 
verse transform. 

In  the  second  approach,  the  hybrid  concept  is  extended  to  interframe  cod- 
ing systems,  that  is,  systems  designed  to  make  use  not  only  of  the  high 
spatial  correlation  that  exists  within  a single  frame  (intraframe),  but  also 
frame-to-frame  correlation.  In  this  system  a two-dimensional  transform  is 
applied  to  each  subblock.  The  transformed  signal  is  then  encoded  in  the  temporal 
direction  using  a bank  of  DPCM  encoders.  Notice  that  this  approach  is  similar  to 
the  first  approach  in  that  it  avoids  the  large  memory  requirement  associated  with 

t Pratt,  op,  cit. 

ttA.  Habibi,  "Comparison  of  the  n^h-order  DPCM  Encoder  with  Linear  Transfor- 
mation and  Block  Quantization  Techniques, " IEEE  Transactions  on  Communica- 
tion Technology,  Vol.  COM-19,  No.  6,  Parti,  December  1971,  pp.  948-956. 
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performing  a transform  in  the  temporal  direction  in  a three-dimensional  en- 
coding system. 

2.5.0  GENERIC  SYSTEM  DESCRIPTION 

Several  transform  encoding  and  hybrid  coding  approaches  for  removing 
video  redundancy  were  discussed  in  the  previous  section.  This  section  is 
directed  at  utilizing  that  discussion  to  formulate  a generic  baseline  jam  re- 
sistant video  system  suitable  for  mini-RPV  applications. 

The  basic  issue  is  whether  the  CID  focal  plane  processor  chip  should  be 
used  to  implement  a one-dimensional  transform  or  a two-dimensional  trans- 
form on  the  image  plane.  Consider  the  comparison  of  a hybrid  encoder  con- 
sisting of  an  r?  point,  one-dimensional  transform  processor  cascaded  with  a 
bank  of  n^  DPCM  encoders  and  a n X n two-dimensional  transform  encoder.  ^ 
Clearly,  both  the  one-  and  two-dimensional  transformations  result  in  a set  of  n 
coefficients  each  of  which  is  a linear  combination  of  the  n^  pixels.  The  dif- 
ference between  the  two  would  be  simply  a matter  of  notation  except  when  pixel 
subblock  size  and  shape  are  considered. 

2,  5.  1 Subblock  Shape  Considerations 

The  following  considerations  clearly  indicate  that  the  CID  focal  plane 
processor  should  be  used  to  implement  a two-dimensional  transform  proces- 
sor: 

• Two-dimensional  transform  encoding  has  exhibited  better  coding  per- 
formance and  degradation  characteristics,  is  less  sensitive  to  data 
statistics,  and  is  less  vulnerable  to  channel  noise  than  the  hybrid  sys- 
tem. 

• As  described  in  Section  2-6,  the  CID  two  dimensional  Hadamard  trans- 
form processor  implementation  does  not  require  a large  block  of  memory 
as  do  other  two-dimensional  processors. 

• Pixel  subblock  shape  investigation  by  Wirtzt  indicates  that  transform- 
ing two-dimensional  arrays  rather  than  one-dimensional  arrays  yields 
slightly  better  performance. 

• A two-dimensional  transform  encoder  allows  the  flexibility  for  exten- 
sion to  interframe  encoding,  either  three-dimensional  or  a hybrid 
system  consisting  of  a two-dimensional  transform  in  a series  with  a 
temporal  DPCM. 


tP.  A.  Wirtz,  "Transform  Picture  Coding,"  Proceedings  of  the  IEEE,  Vol.  60, 
No.  7,  July  1972,  pp.  809-819. 
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2.5.2  Subblock  Size  Considerations 

Mean- square  error  performance  improves  with  increasing  n since  the 
number  of  correlations  increases  with  n.  However,  most  pictures  contain 
significant  correlation  between  pixels  for  only  16  to  20  adjacent  pixels.  In 
fact,  in  the  Hadamard  case  a point  of  diminishing  return  is  reached  for  n>8.  tt 
Even  smaller  n,  say  n = 4,  does  not  significantly  increase  the  error. 

When  subjective  quality  is  the  criterion,  performance  is  essentially  in- 
dependent of  n for  n > 4.  t Since  the  number  of  computations  per  pixel  is  pro- 
portional to  n,  4 X 4 is  a reasonable  choice  for  picture  subblock  size. 

Thus,  depending  upon  the  performance  criterion,  the  optimum  subblock 
size  is  4 X 4 or  8 X 8.  The  choice  of  4 x 4 as  the  block  size,  for  the  jam  resis- 
tant video  transmission  system  and  the  CID  focal  plane  processor  chip,  is  based 
onhardware  implementation  considerations.  As  described  in  Section  2.  6,  the 
realization  of  a 4 x 4 CID  focal  plane  processor  is  the  least  complex. 

2.  5.  3 Baseline  Jam  Resistant  Video  Data  Link  System 

Figure  2-10  shows  a functional  block  diagram  of  the  baseline  jam  resis- 
tant video  transmission  system.  The  hybrid  interframe  encoder  is  selected 
as  baseline.  Although  temporal  compression  has  no  effect  on  the  CID  two- 
dimensional  transform  processor  implementation,  it  is  included  to  satisfy 
the  demand  for  increased  jamming  margin  in  mini-RPV  systems.  The  choice 
of  the  hybrid  system  over  a three-dimensional  transform  encoder  is  based 
solely  on  the  significant  memory  requirement  imposed  by  the  latter. 

Referring  to  Figure  2-10,  the  picture  is  processed  in  4 x 4 subblocks. 

A two-dimensional  Hadamard  transformation  is  performed  on  each  of  the 
subblocks  and  each  of  the  16  transform  coefficients  is  encoded  in  the  tem- 
poral direction  by  a bank  of  digital  DPCM  encoders.  The  encoded  frame-to- 
frame  transform  coefficient  differences  are  transmitted  to  the  ground  station 
or  control  aircraft  over  the  wideband  data  link.  At  the  receiver,  the  quan- 
tized transform  coefficient  is  combined  with  its  predicted  value  to  give  its 
reconstructed  value.  The  16  reconstructed  transform  coefficients  correspond- 
ing to  a particular  4x4  subblock  are  then  sent  to  a digital  inverse  Hadamard 
transform  processor.  Since  all  of  the  transform  coefficients  are  available, 
the  inverse  transform  processor  is  simply  a 16  point  one-dimensional 
Hadamard  transform  which  can  be  implemented  using  standard  "fast"  trans- 
form algorithms  similar  to  the  FFT. 


■^irtz,  op.  cit. 

ttN.  Ahmed,  T.  Natarajan,  and  K.  R.  Rao,  "Discrete  Cosine  Transform," 
IEEE  Transactions  on  Computers,  Vol.  C-23,  No.  1,  January  1974, 
pp.  90-93. 
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This  section  describes  the  CID  focal  plane  processor  implementation  of 
the  desired  two-dimensional  Hadamard  transform  processor.  The  initial 
discussion  reviews  basic  CID  operation  and  introduces  the  basic  principles 
which  allow  the  CID  imager  to  be  compatible  with  "on  chip"  one-dimiensional 
Hadamard  processing.  The  remainder  of  this  section  concentrates  on  the 
extension  of  the  one -dimensional  transform  approach  to  two  dimensions  and 
the  desired  4x4  Hadamard  realization.  In  addition,  a brief  description  of 
an  8 X 8 Hadamard  implementation  is  given. 

2.  6.  1 CID  Imager  - Operational  Description 

A discussion  of  the  operation  of  currently  configured  sensors  will  begin 
based  on  Figure  2-11.  As  shown,  each  light-sensitive  site  consists  of  two 
coupled  potential  wells,  one  of  which  is  controlled  by  an  X,  or  row  address, 
and  the  other  by  a Y,  or  column  address.  The  portion  of  the  well  with  the 
greatest  depth  will  contain  the  accumulated  charge.  Therefore,  by  oroper 
control  of  the  address  voltages,  charge  can  be  transferred  between  row 
and  column  segments  of  the  site.  Finally,  if  voltage  is  removed  T'orn 
both  sections  of  the  site,  the  charge  will  be  injected  into  the  substrate. 
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Readout  of  such  structures  can  be  called  column  readout  and  is  accom- 
plished in  the  following  manner.  Integration  of  charge  is  done  in  the  row  po- 
tential wells.  Initially,  assume  row  X3  is  in  the  same  mode  as  the  other 
rows  and  that  all  switches  are  open.  If  the  S-control  switches  are  now 
closed,  the  column  capacitances  will  be  established  at  voltage  Vg,  after 
which  Si  is  opened  and  the  column  lines  float  at  Vs.  Secondly,  the  video 
amplifier  input  line  is  reset  to  Vy  by  closing  the  reset  switch  momentarily. 
Initial  conditions  are  now  set  for  signal  readout.  Preparation  for  readout 
of  row  X3  can  be  made  by  transferring  the  charge  under  the  column  elec- 
trodes as  shown  in  the  figure.  This,  in  turn,  will  induce  a voltage  change 
in  the  column  lines  which  were  left  floating  at  Vg.  Finally,  readout  is 
achieved  by  sequentially  scanning  the  voltages  of  the  column  lines  by  closure 
of  the  switching  between  those  lines  and  the  video  amplifier  input.  A reset 
function  is  performed  between  each  column  sample  by  closure  of  the  reset 
switch,  thus  re-establishing  the  video  amplifier  to  Vy. 

Some  comments  are  appropriate  with  respect  to  this  method  of  readout. 

It  has  been  demonstrated  successfully  in  operable  devices;  however,  there 
are  several  sources  of  error  in  this  technique,  for  which  a newly  conceived 
row  readout  method  should  provide  improvement.  First,  the  signal  output 
is  a relatively  small  increment  which  is  superimposed  on  the  value  of  Vy  and 
must  be  recovered  external  to  the  chip  by  sample  and  hold  techniques. 
Secondly,  the  signal  can  be  influenced  by  KTC  effects  of  the  three  switching 
functions  used  in  the  readout  cycle.  Finally,  array  nonuniformities 
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arc  not  suppressed.  It  is  an  awareness  of  these  effects  which  led  to  the  con- 
ception of  a row  readout  method  to  be  described  later. 

A final  comment  is  appropriate  with  respect  to  readout.  At  the  conclu- 
sion of  the  above  description,  the  signal  charge  was  left  under  the  column 
electrodes.  Several  demonstrated  options  exist  after  readout.  The  signifi- 
cant aspect  is  that  the  video  information  has  been  extracted  from  the  device 
without  loss  of  the  stored  information.  For  the  normal  imager,  the  row 
voltage  is  raised  and  the  charge  is  injected  in  preparation  for  the  next 
integration  period.  It  can,  however,  be  transferred  back  under  the 
row  and  retained,  thus  providing  a nondestructive  readout  capability.  This 
mode  has  been  demonstrated  where  over  300,  000  readout  operations  were 
conducted  on  a single  stored  image  with  a signal  charge  loss  of  less  thstn  two 
carriers  per  pixel,  per  readout. 

The  connotation,  "parallel  injection,"  is  used  to  imply  that  injection  is 
done  for  a group  of  sites  simultaneously  as  opposed  to  a per  site  injection 
operation.  Commonly,  this  is  done  for  a full  row  during  blanking  time  fol- 
lowing readout  of  that  row. 

All  solid  state  imagers  (CIDs  and  CCDs)  have  been  limited  in  dynamic 
range  by  a fixed  spatial  noise  background  caused  by  variations  in  structure 
and  the  readout  process,  not  by  temporal  noise.  A CID- compatible  row 
readout  method,  conceived  by  General  Electric,  in  principle  should  result 
in  complete  cancellation  of  these  fixed  pattern  effects  through  the  use  of 
differential  techniques.  Additional  advantages  of  the  method  are  elimination 
of  KTC  effects  and  availability  of  a direct  video  output  from  the  chip  with 
associated  simplification  of  the  external  video  amplifier.  Finally,  these 
techniques  are  compatible  to  one-dimensional  "on  chip"  transform  processing 
with  particular  emphasis  on  the  Hadamard  transform. 


One  approach  toward  mechanizing  this  technique  is  illustrated  in 
Figure  2-12.  The  vertical  scanner  sequentially  connects  on  adjacent  pair  of 
row  lines  to  the  differential  inputs  of  the  video  amplifier.  After  row  selection, 
both  lines  are  reset  to  a reference  and  allowed  to  float.  The  RESTORE  switch 
is  then  operated  to  absorb  the  KTC  offset  voltage  across  the  RESTORE  capaci- 
tor. The  video  signal  is  then  assembled  by  sequentially  transferring  the 
charge  from  the  columns  to  the  row  electrodes.  As  each  column  transfers 
its  charge,  the  amplifier  output  is  a measure  of  the  difference  in  charge 
transferred  to  the  two  rows.  In  the  normal  sequence  one  row  will  be  empty, 
having  just  previously  been  cleared  of  signal  (injected).  Note  that  all  para- 
sitic switching  effects  are  seen  as  common-mode  signals  by  the  amplifier  and 
can  be  effectively  rejected.  The  predominant  source  of  interference  is  the 
parasitic  coupling  of  the  column  drive  voltage  to  the  rows  being  sensed.  This 
effect  would  be  attenuated  by  the  amplifier  CMRR.  This  method  measures 


the  difference  between  adjacent  array  lines,  the  addressed  line  with  signal 
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Figure  2-12.  Parallel  Injection  Row- Readout,  Differential 

charge  minus  the  previously  readout  line  after  signal  charge  injection.  This 
allows  cancellation  of  fixed  pattern  noise  caused  by  column  drive  level  differ- 
ences and  coarse  variations  in  array  structure.  Complete  cancellation  could 
be  effected  by  delaying  the  output  from  the  addressed  line  for  one  line  scan 
interval  before  subtracting  the  output  from  the  empty  array  line.  Further  re- 
duction could  be  effected  by  superimposing  the  rise  and  fall  times  of  the 
column  voltages;  that  is,  have  the  charge  transfer  from  the  column  electrode 
coincident  with  the  charge  being  transferred  out  of  the  preceding  column. 

Thus,  the  two  interfering  signals  would  tend  to  cancel  each  other.  It  is  im- 
portant to  note  that  this  scanning  method  forms  a continuous  video  signal  as 
the  columns  are  scanned- -the  sampling  function  is  inherent  in  the  readout  and 
need  not  be  mechanized  externally.  This  greatly  simplifies  sensing  and  re- 
duces noise  bandwidth.  An  additional  advantage  is  the  fact  that  the  combination 
of  injection  during  horizontal  blanking  and  differential  readout  virtually  elim- 
inates blooming  of  the  displayed  image. 

The  advantages  of  this  technique  (pattern  noise  cancellation,  KTC  noise 
elimination,  inherent  signal  sampling,  and  antiblooming)  apply  if  the  row 
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signals  result  from  reading  the  sum  of  a number  of  image  pixels  as  well  as  to 
the  reading  of  a single  image  pixel.  The  method  that  would  be  used  to  obtain 
a row  voltage  that  is  proportional  to  the  sums  (and  differences)  of  a number  of 
image  pixels  is  illustrated  in  Figure  2-13.  At  the  beginning  of  a readout 
operation,  the  signal  charge  at  some  of  the  sites  is  stored  imder  the 
column  electrodes  (qi  and  q2)  and  at  other  locations  along  the  same  row 
the  signal  is  stored  under  the  row  electrodes  (qa  and  q4).  The  row  is  reset  to 
the  reference  voltage  under  this  bias  condition.  If  voltage  is  then  removed 
from  the  first  two  column  electrodes,  charge  packets  qi  and  qa  will  transfer 
to  the  row  electrodes.  At  the  same  time,  voltage  can  be  applied  to  the  third 
and  fourth  columns  causing  charge  packets  qa  and  q4  to  transfer  from  the  row 
electrodes  to  the  column  electrodes.  The  net  change  in  row  voltage  is  pro- 
portional to  the  sum  of  charge  transferred  (qi  + qa  - qs  - q4).  The  summation 
operation  is  controlled  by  the  pattern  of  drive  voltage  changes  applied  to  the 
column  electrodes. 


Figure  2-13.  Image  Plane  Summation  Principle 
2.  6.2  One-dimensional  Hadamard  Transform  CID  Focal  Plane  Processor 


A one-dimensional  Hadamard  transform  mechanization  is  as  shown  in 
Figure  2-14.  The  code  generator  is  used  to  apply  appropriate  voltage  changes 
to  the  column  electrodes  to  obtain  the  indicated  sums  on  the  row  lines.  The 
differential  row  readout  technique  is  used  with  this  transform  imager  to  also 
achieve  low  spatial  and  temporal  noise.  A restore  operation  is  required  be- 
tween each  transform  point  (not  a reset  operation).  KTC  noise  elimination  is 
conserved. 

In  the  process  of  taking  an  image  transform,  the  signal  charge  at  each 
pixel  is  read  out  repeatedly,  once  for  each  transform  value.  For  an  N-wide 
transform,  the  signal  recovered  after  taking  the  inverse  transform  is  N times 
the  signal  at  each  pixel.  The  result  of  this  repeated  readout  operation  is  a 
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Figure  2-14.  One-dimensional  Hadamard  Trans- 
form Implementation 


signal-to-noise  improvement  of  /N.  Since  KTC  noise  can  be  eliminated  by 
using  the  row  readout  technique,  amplifier  noise  will  be  the  dominant  tem- 
poral noise  source.  Noise  levels  of  a few  hundred  carriers  should  be  easHy 
obtained,  the  specific  value  dependent  on  transform  size,  array  size,  pixel 
rate  and  amplifier  design. 

2.  6.  3 Two-dimensional  Hadamard  CID  Focal  Plane  Processor 


The  traditional  approach  to  taking  a two-dimensional  Hadamard  transform 
is  to  take  advantage  of  the  separable  property  of  the  Hadamard  kernel.  This 
property  allows  the  two-dimensional  transform  to  be  realized  by  taking  two 
consecutive  one-dimensional  transforms.  That  is,  a one-dimensional  trans- 
form is  applied  to  each  row  in  the  block  followed  by  a one-dimensional  trans- 
form applied  to  the  columns  of  that  result. 

Figure  2-15  is  a block  diagram  of  an  interframe  encoding  system  using 
a two-dimensional  transform  for  removing  vertical  and  horizontal  correla- 
tion within  a subblock  of  the  sampled  image  array.  Ignoring  the  high  speed 
A/D  converter  issue  for  the  moment,  a limitation  of  this  approach  is  the 
auxiliary  memory  requirement  for  storing  the  intermediate  one-dimensional 
transform  coefficients  of  each  block  of  each  row.  The  size  of  this  memory  is 
significant  in  that  it  is  a function  of  the  size  of  the  block  in  the  vertical  di- 
rection and  the  number  of  resolution  elements  in  a row.  In  fact,  as  shown 
in  Figure  2-15,  twice  this  memory  size  is  required.  In  light  of  these  ob- 
servations the  only  viable  approach  for  implementing  a two-dimensional 
Hadamard  transform  for  mini-RPV  applications  is  the  CID  focal  plane  processor. 
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Figure  2-15.  Conventional  Hybrid  Two-dimensional  Hadamard/Frame-to- 
Frame  DPCM  Interframe  Encoder 

The  solution  to  the  problem  of  performing  a two-dimensional  Hadamard 
transform  on  the  focal  plane  depends  primarily  on  two  issues: 

• Column  Symmetry 

• Pattern  Noise  Cancellation 

The  first  property  is  most  important  because  if  column  symmetry  docs 
not  exist  then  extending  the  one-dimensional  concept  to  two  dimensions  is  not 
possible.  As  discussed  earlier,  the  Hadamard  coefficients  are  generated 
at  the  row  outputs  by  driving  the  array  column  in  a prescribed  manner.  In 
other  words,  given  a subblock  size,  all  of  the  columns  must  have  the  same 
sign  or  be  different  by  a minus  sign  along  the  row.  This  is  illustrated  in 
Figure  2-16.  Pattern  (a)  is  allowed  because  all  of  the  elements  of  each 
column  have  a common  sign.  Pattern  (b)  is  not  allowed  because  columns  1 
and  3 cannot  be  driven  positive  and  negative  simultaneously.  Pattern  (c)  is 
allowed  because  the  columns  can  be  driven  + - + - and  the  desired  output  on 
row  2 can  be  obtained  by  inverting  the  output. 
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Figure  2-16.  Column  Symmetry 

Fortunately,  column  symmetry  does  exist.  Shown  in  Figure  2-17  are  the 
16  Hadamard  patterns  that  would  be  applied  to  a 4 x 4 subblock  of  pixels.  The 
appropriate  coefficients  are  the  sum  of  the  applied  positive  and  negative  weight- 
ing on  the  intensity  at  each  pixel.  Referring  to  Figure  2-17,  notice  that  col- 
umn symmetry  exists  for  all  16  patterns. 
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Figure  2-17.  Two-dimensional  Hadamard  Patterns  as  Applied  to  a 4 x 4 
Subblock  of  Pixels 

1; 

An  operational  sequence  for  generating  the  16  Hadamard  transform  co- 
efficients is  as  follows.  The  Hadamard  code  generator  output  is  such  that 
the  array  columns  are  driven  so  as  to  result  in  the  application  of  pattern 
Goo  to  a particular  4x4  subblock  of  pixels.  That  is,  columns  1 through  4 
are  driven  so  as  to  result  in  a positive  contribution  at  each  row  output.  The 
sum  of  the  row  1,  2,  3,  and  4 outputs  give  the  Goo  coefficient.  Notice  that 
with  no  change  in  the  column  drive  potentials,  Goi  can  be  determined  simply 
by  subtracting  the  sum  of  the  outputs  from  rows  3 and  4 from  the  sum  of 
rows  1 and  2.  A similar  observation  can  be  made  concerning  coefficients 
Go2  and  G03. 

The  array  column  potentials  are  then  driven  so  as  to  result  in  the  ap- 
plication of  pattern  Gio  to  the  4x4  pixel  subblock.  This  pattern  is  used  to 
generate  coefficients  Gio,  Gn,  and  G12  and  G13.  Similarly,  patterns  Ggo  and 
G30  are  used  to  generate  the  remaining  8 Hadamard  transform  coefficients. 

As  discussed  earlier,  the  two-dimensional  Hadamard  transform  focal 
plane  processor  approach  is  not  complete  unless  provision  is  made  for  re- 
ducing pattern  noise.  Two  methods  for  achieving  pattern  noise  cancellation 
are  attractive,  namely: 

(1)  the  block  injection  method,  and 

(2)  the  calibrate  frame  method. 
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In  the  first  method  the  transform  coefficients  are  generated  as  described 
above  and  stored.  The  4x4  pixel  subblock  is  then  injected  and  16  reference 
transform  coefficients  are  generated  on  the  injected  block.  The  reference 
coefficients  are  then  subtracted  from  the  corresponding  transform  coeffi- 
cients resulting  in  the  cancellation  of  the  pattern  noise  contained  in  each 
coefficient.  The  calibrate  frame  approach  is  similar  to  the  block  injection 
method  in  that  pattern  noise  is  canceled  by  subtracting  a reference  coeffi- 
cient generated  on  an  injected  block  from  the  corresponding  noisy  coefficient. 
The  difference,  however,  is  that  this  technique  exploits  the  fact  that  pattern 
noise  does  not  change  appreciably  with  time.  Thus,  in  the  calibrate  frame 
mode  of  operation,  a complete  single  frame  of  reference  coefficients  is 
transmitted  to  the  ground  or  control  aircraft  based  decoder.  The  noisy 
transform  coefficients  are  then  generated  as  described  above,  transmitted, 
and  reconstructed.  The  pattern  noise  contained  in  the  reconstructed  coefficient 
is  canceled  by  subtracting  the  coefficient  from  the  stored  reference.  This 
procedure  is  continued  except  that  periodically  (once  every  hour  or  so)  the 
reference  is  updated. 

An  implementation  of  this  approach,  assuming  the  block  injection  method 
of  pattern  noise  cancellation,  is  shown  in  Figures  2-18  and  2-19.  The  appro- 
priate 4x4  pixel  subblock  is  chosen  by  selecting  a particular  set  of  four 
columns  and  four  rows  via  the  ROW  SELECT  and  COLUMN  SELECT  logic.  The  col- 
umn drive  potentials  are  applied  at  the  four  inputs  to  give  the  Goo  Hadamard 
pattern,  where  the  primed  coefficients  have  not  been  corrected  for  pattern 
noise.  The  four  row  outputs  available  at  pads  A,  B,  C,  and  D are  used  to 
simultaneously  generate  coefficients  Gio,  Gqi,  G02,  G03,  This  off-chip  sum- 
mation is  shown  in  Figure  2-19.  Notice  that  the  four  coefficients  are  stored 


COLUMN  SELECT 


Figure  2-18.  4x4  CID  Focal  Plane  Processor  Mechanization 
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Figure  2-19.  4x4  Hadamard  - Row 

Summation  and  Pattern 
Noise  Cancellation  Logic 


in  a digital  memory  consistent  with  the  requirement  of  the  block  injection 
method  of  pattern  noise  cancellation. 

Next,  the  column  drive  potentials  for  the  selected  subblock  are  driven 
to  give  the  Glo  pattern.  The  four  row  outputs  are  summed  off  chip  in  the  same 
manner  and  coefficients  G{o,  Gh,  G{2  and  Gls  are  stored.  This  process  is 
repeated  for  the  G20  and  G30  patterns.  At  the  completion  of  this  sequence  the 
16  noisy  Hadamard  coefficients  are  stored  as  shown  in  Figure  2-19. 

The  selected  4x4  pixel  subblock  is  then  injected  and  all  16  transform 
coefficients,  G',  are  generated  in  an  identical  manner  over  the  injected 
subblock.  As  each  reference  coefficient,  G*,  is  generated  it  is  subtracted 
from  the  corresponding  coefficients  and  difference  G is  sent  to  the  appro- 
priate DPCM  encoder  for  transmission.  This  sequence  of  operations  is 
shown  in  Figure  2-20. 

This  implementation  is  applicable  to  the  calibrate  frame  method  except 
that  the  16  memory  cells  are  not  required  since  the  uncanceled  coefficients 
are  transmitted  to  the  decoder  where  cancellation  takes  place.  As  indicated 
in  Figure  2-21,  this  approach  results  in  a four  to  one  reduction  in  sample 
processing  rate  relative  to  the  original  pixel  rate  of  the  imager. 

Several  observations  can  be  made  concerning  the  implementation  shown 
in  Figures  2-18,  2-19,  2-20,  and  2-21.  First  of  all,  this  development  is 
not  meant  to  imply  that  the  complete  two-dimensional  transform  cannot  be 
implemented  completely  on  a single  CID  imager  processor  chip,  because  a 
single  chip  realization  is  possible.  There  are,  however,  advantages  to  de- 
signing the  imager  to  perform  four  1x4  transforms  in  parallel  with  the  final 
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tj  - pixel  sample  rate  500  nsec 

G^.j  - uncancelled  coefficient 

G^t  - reference  (injected)  coefficient 

G^j  - cancelled  coefficient 
Assume  zero  injection  time. 

Figure  2-20.  Sequence  of  Operations  - Block  Injection  Method 
of  Pattern  Noise  Cancellation 


tj  - pixel  sample  rate  2 MHz 
- uncancelled  coefficient 


Figure  2-21.  Sequence  of  Operations  - Calibrate 
Frame  Method  of  Pattern  Noise 
Cancellation 

row  summation  done  off  chip.  First  of  all,  the  CID  imaging  chip  is  designed 
to  operate  at  a 2 MHz  sample  rate.  This  means  that  a single  chip  implemen- 
tation using  the  calibrate  method  of  pattern  noise  cancellation  would  re- 
quire a 2 MHz  A/D  converter  at  the  input  to  the  DPCM.  If  the  block 
injection  method  were  implemented,  the  A/D  converter  speed  require- 
ment would  double.  A review  of  A/D  converter  availability  indicates  that 
at  2 MHz  and  above  either  the  converter  is  large  or  expensive.  As  shown 
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in  Figures  2-20  and  2-21,  the  parallel  output  implementation  results  in  a two->. 
to-one  and  a four -to -one  decrease  in  A/D  converter  speed  requirement.  This 
reduction  in  A /D  converter  speed  requirement  allows  compatibility  with  low 
cost  IC  circuitry  and  allows  the  CID  chip  to  be  operated  at  a slower  rate. 

A second  consideration  which  makes  the  parallel  implementation  attrac- 
tive is  the  dynamic  range  requirement  for  the  CID  output  amplifier  is  re- 
duced. That  is,  each  of  the  four  amplifiers  must  handle  the  sum  of  four 
pixel  values,  whereas  in  the  single  chip  realization  the  dynamic  range  of  the 
output  amplifier  would  have  to  cover  the  sum  of  all  16  pixels. 

2.  6.  3.  1 An  8x8  Hadamard  Transform  Implementation  on  the  Focal  Plane. 


The  following  discussion  describes  an  8 x 8 two-dimensional  CID  focal  plane 
Hadamard  transform  implementation,  illustrating  how  the  basic  4x4  tech- 
nique can  be  extended  to  larger  subpicture  block  sizes.  There  is  evidence 
that  no  substantial  improvement  in  performance  is  obtained  for  the  Hadamard 
transform  for  subpicture  sizes  greater  than  8 x 8.t 

Figure  2-22  shows  eight  of  the  64  possible  Hadamard  patterns  that  would 
be  applied  to  an  8 x 8 subblock  of  picture  elements.  The  appropriate  co- 
efficients are  the  sum  of  the  negative  and  positive  weighting  on  the  intensity 
at  each  pixel.  A CID  imager  chip  designed  to  implement  the  8x8  directly 
would  follow  an  operational  sequence  completely  analogous  to  that  described 
previously  concerning  the  4x4  Hadamard  implementation.  A direct  imple- 
mentation, however,  would  require  eight  row  sense  amplifiers,  thus  present- 
ing hardware  implementation  difficulties.  The  following  paragraphs  de- 
scribe how  an  8 X 8 Hadamard  transform  can  be  implemented  using  the  same 
basic  structure  as  the  4x4  chip,  that  is,  using  4 four-input  code  control 
lines  and  four  row  outputs.  The  approach,  therefore,  is  to  investigate  the  symme- 
tries of  the  8x8  transform  pattern,  the  objective  being  to  generate  8x8  from  two 
4x8  transforms. 

Consider  first  the  task  of  driving  the  eight  columns  of  the  4x8  block 
so  as  to  apply  the  appropriate  Hadamard  pattern.  Notice  from  Figure  2-22 
that  the  symmetry  of  the  generating  patterns  (leftmost  column)  is  such  that 
all  that  is  required  is  that  an  inverter  stage  be  added  between  each  group  of 
four  columns.  The  modification  to  the  basic  4x4  chip  is  illustrated  in 
Figure  2-23.  Notice  that  this  minor  modification  allows  32  of  the  64  or  1/2 
of  the  total  number  of  Hadamard  coefficients  to  be  generated. 

The  symmetry  that  allows  the  remaining  32  patterns  to  be  calculated 
can  be  seen  from  the  top  row  of  8 x 8 transform  coefficient  patterns  in  Fig- 
ure 2-22.  The  difference  between  the  first  eight  coefficients  across  the  row 
and  the  second  eight  is  that  the  lower  4x8  block  weightings  differ  by  a 

+ N.  Ahmed,  T.  Natarajan,  and  K.  R.  Rao,  "Discrete  Cosine  Transform," 

IEEE  Transactions  on  Computers,  Vol.  C-23,  No.  1,  January  1974, 
pp.  90-93. 
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Figure  2-22.  8x8  Hadamard  Transform  Patterns 

factor  of  -1.  That  is,  comparing  the  first  pattern  with  the  fifth  pattern  in  the 
top  row  of  Figure  2-22,  it  is  seen  that  the  result  obtained  by  applying  the 
appropriate  pixel  pattern  to  the  lower  4x8  block  in  the  first  pattern  differs 
only  in  sign  from  the  result  require'’  by  the  lower  4x8  block  in  the  fifth 
pattern.  Thus,  the  result  need  only  be  calculated  once. 

The  operational  sequence  is  to  select  the  upper  4 x 8 of  the  8x8  subblock 
by  addressing  the  appropriate  ROW  SELECT  lines.  Eight  columns  are 
selected  by  addressing  the  appropriate  two  adjacent  COLUMN  SELECT  lines. 
With  the  inverter  control  off,  an  all-positive  pattern  is  applied  at  the  input 
resulting  in  a 4 x 8 block  of  positive  pixel  weightings.  The  four  partial  Hada- 
mard transform  coefficients  are  calculated  and  stored  in  the  same  manner  as  de- 
scribed in  the  4 x4  implementation.  In  fact,  as  shownin  Figure  2-24,  the  off-chip 
row  summation  logic  is  identical.  Now,  without  changing  the  input  pattern, 
the  appropriate  inverters  are  turned  "on"  resulting  in  the  application  of  the 
fifth  pattern  in  the  leftmost  column  (see  Figure  2-22)  to  the  same  upper 
4x8  pixel  subblock.  The  four  partial  Hadamard  results  are  generated  in 
the  same  manner.  This  procedure  is  continued  until  all  32  unique  upper 
4x8  results  are  obtained  and  stored. 
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Figure  2-24.  8x8  Iladamard  Transform  - Row  Summation 

and  Pattern  Noise  Cancellation  Logic 


The  upper  4 x 8 is  then  injected  and  the  32  required  reference  values  are 
generated  and  pattern  noise  cancellation  is  achieved  as  shown  in  Figure  2-24, 


The  lower  4x8  block  is  then  addressed  via  the  ROW  SELECT  logic 
and  the  identical  procedure  is  followed  for  generating  the  32  pattern  noise- 
free  results.  At  this  point  in  the  sequence  the  upper  and  lower  results 
corresponding  to  the  first  four  columns  (32  coefficients)  in  Figure  2-22  are 
stored.  As  shown  in  Figure  2-24,  all  64  coefficients  are  then  generated  by 
adding  and  subtracting  the  lower  4x8  results  from  the  upper  4x8  results. 

In  summary,  it  is  possible  to  perform  FFT  type  operations  on  the  focal 
plane  to  realize  larger  subblock  transforms.  The  8x8  subblock  transform 
provides  more  processing  gain  and  near  theoretical  coding  performance  at 
the  same  expense  in  array  and  off-chip  complexity. 

2.  7.  0 INVERSE  HADAMARD  TRANSFORM  APPROACHES 

Several  approaches  for  performing  the  inverse  Hadamard  transform  were 
considered  during  the  study.  A digital  iterative  implementation  is  compared 
to  two  sampled  analog  implementations  using  the  General  Electric  proprietary 
SCT  correlator  and  matrix  multiplier  devices,  a comparison  which  indicates 
that  the  digital  approach  is  superior.  The  major  reason  is  that  the  data  is 
digital  at  the  input  to  the  inverse  transform  processor. 

The  three  approaches  are  described  in  the  following  paragraphs.  It 
should  be  noted  that  all  three  implementations  take  advantage  of  the  fact  that 
all  of  the  coefficient  data  are  available  for  processing  and  the  4x4  inverse 
Hadamard  transform  can  be  implemented  as  a 16  point  one-dimensional 
transform. 

2.  7.  I SCT  Correlator  Implementation 

The  SCT  correlator  t is  a surface  charge  device  capable  of  correlating 
an  analog  waveform  with  a digital  reference.  This  is  a very  powerful  signal 
processing  technique  because  it  performs  parallel  analog  summation  oper- 
ations under  digital  control  at  high  data  rates.  A correlator  structure  with 
parallel  digital  input  capability  is  diagrammed  in  Figure  2-2  5.  The  inverse 
transform  operation  would  be  mechanized  by  loading  the  16  two-dimensional 
transform  coefficients  into  analog  storage  and  then  successively  applying 
the  16  Hadamard  binary  patterns  to  the  digital  inputs.  A correlator  would 
be  the  preferred  approach  for  performing  the  inverse  transform  function  for 
a wide  transform;  however,  its  use  does  not  appear  to  be  justified  for  this 
particular  application  for  two  reasons.  First,  the  transform  coefficients 


tJ.J.  Tiemann,  W.  E.  Engeler,  and  R.  D.  Baertsch,  "A  Surface  Charge 
Correlator,"  IEEE  Journal  of  Solid  State  Circuits,  Vol.  SC-9,  No.  6, 
December  1974,  pp.  403-410. 
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are  available  from  the  data  link  in  digital  form  and  the  frame  store  memory 
would  most  likely  be  digital.  The  use  of  a correlator  would  require  D/A 
conversion  prior  to  the  inverse  transform  operation,  and  A/D  conversion 
following  that  operation.  Secondly,  the  size  of  the  inverse  transform  com- 
putation, 16  additions /subtractions,  is  small  enough  to  be  easily  mechanized 
in  digital  form  with  existing  MSI  circuitry. 

2.7.2  Matrix  Multiplier  Implementation 

A family  of  CCD  matrix  multiplier  chips  is  currently  under  development 
at  the  General  Electric  Company's  Research  and  Development  Center. 

This  family  is  being  developed  to  eliminate  the  complicated  peripheral 
circuitry  of  previously  considered  CCD  transform  signal  processing  ap- 
proaches. In  addition,  the  signal  processing  operations  are  all  performed 
in  parallel  so  that  extremely  high  speeds  (complete  transform  in  100  nano- 
seconds) are  possible.  The  family  will  require  essentially  no  clock  drivers, 
and  output  circuits  are  all  on  chip.  The  basic  multiplier  module  will  be 
16  X 16  elements  and  will  perform  the  mathematical  operation 
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That  is,  a column  vector  of  input  voltages  will  be  multiplied  by  a matrix  of 
fixed  weights  (on  chip)  to  yield  a column  vector  of  output  voltages  simulta- 
neously (see  Figure  2-26).  For  this  application  the  weights  W-  are  the 
appropriate  1 and  -1  weights  required  by  the  inverse  Hadamard  transform. 

The  comments  concerning  the  suitability  of  the  SCT  correlator  approach 
also  apply  to  the  matrix  multiplier  approach. 
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2.  7.  3 Digital  Iterative  Implementation 

Figure  2-27  shows  an  iterative  implementation  based  upon  a fast  algorithm 
which  gives  identical  stage-to-stage  geometry.  This  results  in  a hardware 
savings  in  that  the  hardware  can  be  reduced  to  a single  stage  with  feedback. 
Thus  the  desired  inverse  transform  is  accomplished  after  the  Hadamard  co- 
efficient data  are  fed  back  to  the  input  via  the  input  multiplixer  four  times. 
Every  fourth  cycle  the  new  transform  data  are  entered  through  the  input 
multiplixer.  These  data,  in  turn,  are  cycled  four  times  during  which  time 
the  previous  block  of  fixed  values  are  read  into  the  frame  store  memory. 

The  transform  coefficients,  must  be  scrambled,  as  shown  in  Figure  2-27, 

prior  to  processing  to  take  into  account  the  order  in  which  they  are  generated 
by  the  focal  plane  processor. 
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3.0  SYSTEM  DESCRIPTION 


3.  1 cm  ARRAY  DESIGN 
3.  1.  1 Cell  Layout 

Figure  3-1  shows  the  1.2  x 1.2  mil  cell  layout  of  the  128  X 128  sensor. 
The  thick-thin  oxide  boundary  is  dashed,  the  lower  conductor  (N-doped  poly- 
silicon) crosshatched,  and  the  upper  level  (N-doped  polysilicon)  conductor  is 
shown  in  solid  outline.  The  lower  level  poly-thin  oxide  capacitor  has  an 
area  of  0.  21  mil^  and  the  upper  level  poly-thin  oxide  capacitor  has  an  area 
of  0.28  mil^.  Since  the  upper  level  capacitor  has  a thicker  dielectric  than 
the  lower  level  capacitor,  the  charge  storage  capacity  of  each  electrode  is 
approximately  the  same,  1.  9 x 10®  carriers.  Depletion  capacitance  loading 
limits  the  maximum  output  charge  to  1.  5 x 10®  carriers. 

Both  levels  of  N-doped  polysilicon  conductors  have  a sheet  resistivity  of 
approximately  10  per  square.  An  alternative  approach  is  to  substitute 
metal-oxide  for  the  polysilicon  on  the  upper  level.  This  would  result  in 
higher  sensitivity  since  the  metal-oxide  is  highly  transparent. 


k- 1.2  MILS  H 


Figure  3-1.  Cell  Layout 


3.  1.  2 Array  Layout 

The  array  (Figure  3-2)  contains  128  rows  and  128  columns,  selected  by 
groups  of  four  on  both  the  horizontal  and  vertical  axes.  Since  this  array  was 
designed  for  sequential  readout  of  the  image  subblocks,  selection  is  by  means 
of  scanning  registers.  In  operation,  a logical  "one"  would  be  entered  into 
each  scanning  register  and  shifted  as  required  to  select  the  desired  subgroup. 
The  column  drive  lines,  Ei  through  E4,  would  then  be  driven  to  obtain  four 
transform  outputs  in  parallel. 
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In  addition  to  the  128  active  rows,  an  additional  row  is  available  to  pro- 
vide differential  cancellation  of  column  drive  interference.  This  compensa- 
tion row  is  selected  for  every  row  address  and  cleared  when  every  row  is  cleared 


The  five  on-chip  MOSFET  preamplifiers,  shown  at  the  lower  right  of 
Figure  3-2,  are  optional.  By  means  of  photo-mask  selection,  these  devices 
can  be  bypassed  should  off-chip  preamplification  be  desired. 

Site  size  is  1.2  x 1.2  mils,  giving  an  active  sensing  area  of  153.  6 x 
153.  6 mils.  Overall  chip  size  is  approximately  200  X 200  mils  (5x5  mm). 

3.  1.  3 Array  Parameters 

The  calculated  array  electrical  parameters  for  the  128  x 128  format  are 
shown  in  Table  3-1. 


Table  3-1 

ELECTRICAL  PARAMETERS 


Cell  Storage  Capacity 

1. 9 X 10® 

Saturation  Output  Charge 

1.  5 X 10®  (.  24  pC) 

Distributed  Row  Capacitance  (Cj^Q^y) 

6 pF 

Sense  Line  Capacitance  (Cg) 

12  pF 

Distributed  Row  Resistance 

3.  9 K 

Row  Select  Transistor  Resistance 

4K 

1 

3.2.0  SYSTEM  LOGIC  AND  TIMING 

The  timing  diagram  for  transform  readout  shown  in  Figure  3-3  is  gener- 
ated by  the  logic  diagram  shown  in  Figure  3-4.  Block  1 is  a voltage  controlled 
oscillator  which  has  two  clock  outputs,  one  fixed  and  one  variable.  Block  2 
switches  between  the  two  clocks.  The  outputs  of  counter  3 are  the  clock  fre- 
quency divided  by  2 and  divided  by  8.  Gates  4-8  select  which  of  the  two  frequen- 
cies to  be  fed  into  counter  9.  Its  outputs  are  used  as  inputs  for  the  PROM. 
The  PROMs  are  32  words  of  8 bits  each.  The  switching  of  counter  frequencies 
allows  generation  of  the  first  16  words  at  low  frequency  and  the  second  16  words 
at  high  frequency,  thus  allowing  more  precise  placement  of  the  signals  for  in- 
jection, reset,  etc. 

One  of  the  PROM  outputs  is  a pulse  labeled  0.  The  rising  edge  of  this 
pulse  turns  off  a phase  line  and  the  falling  edg^e  of  the  pulse  turns  on  the  other 
phase  line.  This  is  done  by  using  the  pulse  as  the  clock  input  to  a positive 
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g Diagram  for  Transform  Readout 


CLOCK 


Figure  3-4.  Logic  Diagram  for  Transform  Readout 


edge-triggered  flip-flop  (14),  while  inverting  the  pulse  and  using  it  as  the  clock 
input  to  another  positive  edge-triggered  flip-flop  (15).  Both  noninverted  outputs 
are  NANDed,  giving  0i,  while  the  inverted  outputs  are  NANDed,  giving  0a. 
Blocks  22,  23  are  drivers  as  are  blocks  24,  25,  30-38,  and  40,  thus  provid- 
ing the  required  voltage  levels  needed  for  the  chip. 

The  counter  9 output,  which  cycles  once  every  PROM  interval,  is  divided 
by  32  to  give  one  pulse  every  line.  This  is  NANDed  with  the  0 signal.  Then 
01Y  and  0aY  are  generated  the  same  way  as  0in  and  02H-  'Th®  once-a-line 
pulse  is  also  used  to  generate  When  02^  turns  off  while  the  once  a line 

pulse  is  on,  the  output  of  flip-flop  30  turns  on.  The  next  time  that  02j^  turns 
off,  the  once-a-line  pulse  is  off,  so  the  flip-flop  output  is  off.  The  flip-flop's 
inverted  output  is  then  used  as  The  once-a-line  pulse  is  divided  by  32, 

to  give  a pulse  once  every  frame.  This  signal  is  used  to  generate  in  the 
same  way  as  was  generated. 

All  the  other  necessary  signals  are  from  PROM  outputs  driven  by  32 
through  38  and  40,  to  give  the  necessary  levels.  RESTORE  and  SAMPLE 
are  sent  directly  to  switches  on  the  sense  amplifier  side  of  the  camera. 

The  assembled  transform  readout  camera  board  is  shown  in  Figure  3-5. 
Logic,  timing,  and  drive  circuits  are  to  the  left  of  the  2 8 PIN  imager  package 
(center  white  ceramic  package),  and  the  four  video  amplifiers  to  the  right. 


Logic  and  timing  diagrams  for  the  normal  readout  camera  are  shown  in 
Figure  3-6  and  Figure  3-7,  respectively. 


Figure  3-5.  Camera  Circuit  Board 
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CLOCK  I 


Figure  3-6.  Log 


Figure  3-7.  Timing  Diagram  for  Normal  Readout 


3,3.0  VIDEO  SIGNAL  RECOVERY 

The  four  parallel  video  amplifier  channels  have  been  shown  in  functional 
diagram  form  in  Figure  3-2,  During  readout  a 4 x 4 subblock  is  selected,  4 
columns  by  the  horizontal  scanning  register,  and  4 rows  by  the  vertical  scan- 
ning register.  A compensation  row  is  always  selected  to  allow  the  column  d’  ive 
voltage,  which  couples  to  the  row  conductors,  to  be  cancelled  by  the  differen- 
tial amplifiers. 

The  readout  sequence  then  proceeds  as  follows: 

1.  All  rows  are  reset  to  a reference  voltage,  RVD,  and  allowed  to  float, 

2.  The  KTC  offset  noise  is  removed  by  operating  the  RESTORE  switches 
to  acquire  samples  of  the  offset  voltages  across  the  restore  capacitors. 

3.  The  column  conductors  are  driven  through  connections  Ej,  E2,  E3,  and 
E4  either  in  a time  sequential  (Normal  Readout)  or  Walsh  code  (Trans- 
form Readout)  manner  to  transfer  signal  charge  to  and  from  the  row 
electrodes.  The  restore  switches  are  operated  between  each  column 
drive  voltage  change  to  provide  the  proper  zero  reference. 

4.  After  all  data  from  either  the  addressed  block  (Transform  Readout) 
or  addressed  rows  (Normal  Readout)  has  been  read  out,  that  section 
of  the  array  is  cleared  of  signal  charge  by  driving  the  injection 
transistors  (IG  & ID)  and  the  appropriate  column  conductors  to  cause 
signal  injection.  The  video  amplifiers  would  be  disconnected  during 
the  injection  operation  by  switching  off  gate  DG, 
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A detailed  schematic  diagram  of  one  of  the  four  identical  readout  ampli- 
fiers is  shown  in  F'igure  3-8. 

ON  OFF 


SAMPLED 

VIDEO 


Figure  3-8.  Video  Amplifier  Schematic 


4.0  FABRICATION  PROCESS 


The  CID  Processor  chips  were  fabricated  using  the  P-channel  overlapping 
electrode  process  with  both  the  lower  and  upper  electrodes  formed  from  N- 
type  polysilicon  layers.  This  process  has  been  developed  particularly  for 
the  fabrication  of  solid-state  imagers  and  incorporates  many  safeguards  to 
maintain  a reasonably  high  yield  even  with  large  chip  size. 

For  the  subject  devices  we  were  able  to  obtain  a functional  yield  of  87^ 
and  a line  defect-free  yield  of  21'^  using  high-quality,  hard  material  masks. 
These  results  are  outstanding  considering  that  the  chip  size  is  190  x 210  mils, 

, larger  than  most  memory  or  microprocessor  chips.  A photo  of  the  array  is 

presented  in  Figure  4-1.  A detailed  distribution  of  defects  among  the  various 
elements  of  the  array  is  shown  in  Table  4-1. 

Table  4-1 

PROCESSING  RESULTS 


Wafer  No. 

Functional 

Defects 

Defect  F’ree 

Defect  Free  & 

Low  Dark  Content 

Row 

Column 

Vertical 

Register 

Horizontal 

Register 

1 

1 

56 

52 

16 

29 

2 

1 

13 

5 

2 

56 

50 

20 

22 

1 

1 

13 

9 

3 

56 

46 

23 

11 

1 

7 

13 

6 

4 

56 

14 

28 

3 

1 

O 

12 

3 

5 

56 

18 

17 

1 

4 1 

1 

14 

11 

6 

56 

13 

25 

9 

2 

7 

3 

Total 

336 

293 

104 

132 

20 

15 

72 

37 

100 

87 

31 

39 

6 

4 

21 

11 

The  starting  material  consisted  of  epitaxial  silicon  wafers,  with  the  sub- 
strate heavily  doped  with  boron;  the  epitaxial  layer  was  phosphorus-doped 
with  a resistivity  of  10  ji-cm.  The  thickness  of  the  epitaxial  layer  was  ap- 
proximately 25  pm. 
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Figure  4-1.  Chip  Photomicrograph 


The  field  oxide  is  partially  countersunk  into  the  silicon  surface  for  elimin- 
ating large  and  abrupt  steps  at  the  edges  of  the  active  regions.  Tliis  allows 
the  use  of  thicker  field  oxides,  providing  higher  field  threshold  voltages 
(~30  V (g|l|Ja)  and  lower  parasitic  capacitance  (~0.  018  pF/mil^). 


The  lower  level  electrode  is  made  of  chemical  vapor-deposited  poly- 
silicon, which  is  then  phosphorus-doped  to  increase  its  electrical  conduc- 
tivity. A sheet  resistance  of  about  10  ^ per  square  was  measured  on  a 


polysilicon  layer  5000  A thick.  A gettering  process  is  coupled  to  polysilicon 
doping  for  improving  the  imagers'  dark  current  characteristics. 

Tlie  polysilicon  lines  are  selectively  passivated  by  growing  about  3000  A 
of  oxide  in  steam.  Thus  the  interlevel  capacitance  is  only  0.  016  pF /mil^. 

By  comparison,  the  polysilicon  electrodes'  capacitance  in  the  active  regions 
is  0.  26  pF/mil^  with  a threshold  voltage  of  -1.  6 V.  A second  level  of  poly- 
silicon was  used  for  the  upper  electrode,  but  it  did  not  extend  to  the  scan- 
ning registers  section.  The  top  metallization  in  the  scanning  registers  was 
aluminum  evaporated  from  an  induction-heated  crucible. 

Three  lots,  of  6 wafers  each,  were  processed  for  this  program.  In  the 
first  two  lots  we  used  emulsion  photomasks  since  hard  material  ones  were 
not  readily  available.  Yield  was  very  low  in  these  early  lots,  particularly 
in  the  shift  registers.  In  the  course  of  the  failure  analysis  we  were  able  to 
correlate  this  yield  loss  to  a geometrical  distortion  of  the  emulsion  masks, 
known  as  the  Ross  effect.!  Basically,  this  is  due  to  the  difference  in  drying 
rates  between  exposed  and  unexposed  gelatin  during  development  of  emulsion 
photomasks.  Shrinking  of  the  dark  regions  by  as  much  as  0.  05  mils  at  each 
edge  is  often  observed.  In  our  case,  the  failure  occurred  when  a polysilicon 
line  overlying  a field  oxide  strip,  designed  to  be  0.  1 mil  wider  at  each  edge, 
turned  out  to  be  coincident,  because  of  the  concomitance  of  the  Ross  effect 
in  the  polysilicon  and  field  oxide  patterns.  The  aluminum  lines  could  not  cross 
this  enhanced  step  and  broke  frequently,  decreasing  the  yield. 

With  the  introduction  of  hard  material  masks  this  problem  disappeared 
and  the  high  yield  of  the  third  lot,  previously  mentioned,  was  observed. 
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5.0  PERFORA\ANCE 


The  CID  processor  arrays  were  tested  in  both  the  normal  mode  (sequential 
scan)  and  the  transform  mode.  Experimental  results  are  tabulated  and  com- 
pared to  the  specifications. 

5.  1 IMAGER  PERFORMANCE  - NORMAL  READOUT 

A series  of  eight  packaged  arrays  from  the  third  lot  was  tested  in  the 
normal -readout  camera.  Nondestructive  readout  was  verified  on  all  of  them, 
as  the  camera  was  set  up  for  multiple  frame  integration.  In  this  mode  the 
charge  could  be  injected  after  n frames  where  n could  be  varied  from  1 to 
1000.  Other  device  characteristics  for  the  series  are  shown  in  Table  5-1. 

All  values  are  for  a readout  rate  of  30  frames /second.  The  gain  factors  used 
for  these  calculations  are  based  on  capacitance  measurements  and  are  de- 
rived in  Appendix  B. 

The  experimental  measurements  were  made  using  the  data  collection  sys- 
tem shown  in  Figure  5-1.  The  heart  of  the  system  is  a microcomputer,  con- 
sisting of  an  Intel  8080  processor  and  24  kilobytes  of  user-accessible  memory. 
A 12 -bit  A/D  converter  along  with  timing  logic  is  used  to  convert  the  video 
signal  into  digital  form  for  input  to  the  microcomputer  where  it  is  processed 
under  software  control.  A teletype  and  control  panel  are  used  to  control  the 
data  collection.  This  system  was  used  to  measure  the  following  character- 
istics. 

5.  1.  1 Dynamic  Range 

Dynamic  Range  was  measured  by  first  taking  100  readings  with  no  illum- 
ination. Then  100  readings  were  taken  under  full-scale  illumination  and  the 
mean  value  of  the  background  subtracted  from  each  reading.  The  dynamic 
range  was  the  average  value  of  these  100  readings  of  the  signal-minus-back- 
ground,  divided  by  the  standard  deviation  of  those  readings. (the  RMS  noise 
level).  The  light  source  used  was  a tungsten  point  arc  lamp. 

The  dynamic  range  measured  was  about  500:1  for  all  arrays.  This  was 
achieved  with  the  on-chip  signal  attenuation  of  2:1  ahead  of  the  amplifiers  as 
described  in  Appendix  B.  If  the  layout  error  responsible  for  this  signal 
attenuation  were  corrected,  a dynamic  range  of  1000:1  would  by  achieved. 

5.  1.  2 Dark  Current 

The  dark  current  levels  were  measured  using  the  multiple  frame  in- 
tegration feature  of  the  camera.  Dark  current  buildup  was  measured  after 
200  and  300  frames  of  integration.  The  background  levels  were  quite  low, 
allowing  about  17  seconds  to  reach  saturation  at  25  °C,  equivalent  to  about 
500:1  peak  signal  to  average  dark  current  ratio,  although  all  of  the  arrays 
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Table  5-1 

DEVICE  CHARACTERISTICS 


Device 

Number 

Dynamic 

Range 

Dark  Current 
nA  /cm^ 

Sensitivity 

a/w 

3-5-44 

523:1 

1,  06 

. 14 

1 

LO 

CO 

504:1 

1.25 

. 15 

3-5-30 

491:1 

1.20 

. 14 

3-5-28 

568:1 

0.  82 

. 16 

3-5-20 

534:1 

1.  06 

. 14 

3-3-46 

547:1 

1.  11 

. 17 

3-3-40 

513:1 

1.  06 

. 16 

3-3-28 

528:1 

0.  82 

. 15 

had  a few  dark  current  "spikes."  The  variation  in  the  background  dark  cur- 
rent level  between  arrays  is  partially  due  to  the  variation  in  temperature  of 
the  arrays.  Chip  temperature  increased  by  approximately  15°C  during  oper- 
ation. This  variation  can  be  reduced  by  decreasing  the  power  dissipated  by 
the  on-chip  preamplifiers. 

5.  1.  3 Spectral  Response 

A representative  spectral  response  (Figure  5-2)  was  taken  on  an  array  from 
lot  2 using  a calibrated  monochrometer.  The  peak  quantum  efficiency  (454) 
occurs  at  a wavelength  of  , 66  pm.  This  series  of  devices  was  tested  for  re- 
sponse at  this  wavelength  using  a collimated  light  source  and  narrow  band 
interference  filter,  A United  Detector  Teclinology  calibrated  silicon  photode- 
tector was  used  as  a reference.  The  results  are  tabulated  in  Table  5-1. 

5.  1.  4 MTF 

Data  was  taken  on  the  arrays  to  determine  a point  spread  function,  using 
a 0.  1 mil  light  spot  from  the  tungsten  arc  lamp.  The  light  spot  was  moved 
along  a row  and  column  in  l/lO  element-width  increments.  These  results 
are  shown  in  Figures  5-3  and  5-4.  The  transfer  function  was  measured  using 
a series  of  neutral  density  filters.  This  is  shown  in  k’igure  5-5. 

5.  1.  5 Uniformity 

Pixel-to-pixel  background  variations  (fixed-pattern  noise)  were  measured 
by  first  taking  the  mean  of  2 5 readings  at  each  of  50  sites  along  an  unillumin- 
ated row.  This  was  to  induce  temporal  noise.  The  49  differences  between 


46 


0.4  0.5  0.6  0.7  0.8  0.9  1.0 

WAVELENGTH  (MICRONS) 


Figure  5-2.  Spectral  Response 

the  mean  background  values  for  adjacent  sites  along  the  row  were  then  summed 
and  divided  by  49  to  determine  the  average  pixel-to-pixel  background  varia- 
tion. Typical  results  are  shown  in  Figure  5-6. 

The  decrease  in  fixed-pattern  noise  with  increasing  row  number  is  attrib- 
uted to  increasing  effectiveness  of  the  compensation  row,  which  is  Row  128. 

Pixel-to-pixel  sensitivity  variations  were  measured  by  first  finding  the 
mean  signal  (25  readings)  for  3/4-full  scale  illumination,  minus  the  mean 
signal  (2  5 readings),  for  no  illumination,  at  each  of  50  sites  along  a row.  The 
49  differences  of  these  signal-minus-background  values  for  adjacent  sites  were 
then  averaged  to  determine  the  pixel-to-pixel  sensitivity  variation.  Figure  5-7 
shows  that  the  variation  in  sensitivity  is  less  than  the  background  variations, 
and  does  not  vary  significantly  across  the  array. 

5.  1.  6 Qualitative  Performance 

A photograph  of  the  monitor  display  produced  by  a typical  imager  operat- 
ing in  the  normal  readout  mode  is  shown  in  Figure  5-8.  A few  bright  defects 
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Figure  5-5,  Transfer  Characteristics 


Figure  5-6.  Element-to-Element  Variations  in 
Fixed  Pattern  Noise 


Figure  5-8,  Typical  Image,  Normal  Readout 


due  to  localized  dark  current  can  be  seen.  Unfortimately,  the  wide  dynamic 
range  and  low  dark  current  measured  on  the  video  signal  cannot  be  shown  due 
to  limitations  of  the  image  reproduction  system  used. 


5.2  IMAGER  PERFORMANCE  - TRANSFORM  READOUT 


Several  devices  from  lot  3 were  tested  in  the  transform  camera.  All 
imagers  tested  demonstrated  that  the  spatial  transform  was  being  taken.  Each 
Iladamard  transform  value  is  simply  a binary  summation  of  the  analog  signals 
from  a group  of  pixels.  Thus,  the  weighting  factor  of  each  analog  signal  is 
+1  or  -1.  A one-dimensional  transform  of  a four  element  block  is  accom- 
plished as  follows.  The  first  transform  point  (Ti),  the  lowest  spatial  fre- 
quency or  DC  level  is  the  sum  of  the  charge  in  each  of  the  four  elements 
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{++++).  The  next  highest  frequency  (T2)  is  the  sum  of  the  charge  in  the  first 
two  elements  minus  the  sum  of  the  charge  in  the  second  two  elements  (++--). 
The  third  transform  point  {T3)  is  (+--+)  and  the  fourth  transform  point  (T4), 
the  highest  spatial  frequency,  is  (+-+-).  These  results  are  summarized  in 
Figure  5-9. 


Ti  = Pi  + P2  + P3  + P4 
T2  = Pi  + P2  - P3  - P4 
T3  = Pi  - P2  - P3  + P4 
T4  = Pi  - P2  + P3  - P4 

Where  T = Transform  Value 
P s Pixel  Value 

Figure  5-9.  Transform  Readout  Waveforms 
(No  Illumination) 

In  the  present  array  structure,  four  of  these  one-dimensional  transforms 
are  read  out  in  parallel,  and  a two-dimensional  transform  may  be  performed 
off-chip. 

One  way  to  verify  transform  operation  is  to  illuminate  only  one  of  the 
elements  in  the  four  element  block,  and  observe  the  four  transform  points 
on  an  oscilloscope.  When  the  array  is  dark  all  four  transform  points  are 
zero  (see  Figure  5-9).  (The  hold  time  for  the  fourth  transform  point  is 
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I longer  than  the  hold  time  for  the  other  three  because  the  shift  register  must 

I shift  to  the  next  four-element  block  during  this  time).  When  only  the  first 

I of  the  four  elements  is  illuminated,  the  first  transform  point,  the  sum  of  the 

I charge  in  all  four  elements,  will  read  +1  unit,  on  a normalized  scale.  The 

I second  transform  point  also  will  equal  +1  unit,  since  the  sum  of  charge  in  the 

I first  two  elements  is  1 and  the  sum  of  charge  in  the  last  two  elements  is  0. 

Similarly,  the  third  and  fourth  transform  points  will  equal  +1  unit.  This  is 
1 shown  in  Figure  5- 10(a).  Now  the  light  spot  is  moved  so  as  to  illuminate  only 

the  second  element  of  the  four.  The  first  transform  point  is  still  +1  since  the 
sum  of  the  charge  for  the  four  elements  is  still  +1  unit.  The  second  trans- 
form point  is  also  +1  unit.  The  third  transform  point  is  now  -1  unit  because 
it  is  the  sum  of  the  charge  in  the  first  and  fourth  element  (0)  minus  the  charge 
in  the  second  and  third  element  (1).  Similarly  the  fourth  transform  point  is 
-1.  This  is  shown  in  Figure  5- 10(b).  When  the  light  spot  illuminates  the  third 
element  only,  the  transform  points  are  +1,  -1,  -1,  and  +1  respectively  [Fig- 
ure 5- 10(c)].  Finally,  when  the  light  spot  illuminates  only  the  fourth  element 
the  four  transform  points  are  +1,  -1,  +1,  and  -1,  respectively  [Figure  5-10(d)]. 
It  should  be  emphasized  that  the  waveforms  of  Figure  5-10  are  sampled  analog 
quantities.  The  very  narrow  point  spread  function  of  these  imagers  and  the 
good  transform  readout  quality  results  in  uniform  analog  samples  that  should 
not  be  mistaken  for  digital  signals. 

The  performance  characteristics  of  the  imagers  in  the  transform  mode 
were  measured  when  applicable.  NDRO  operation  is  inherent  in  the  trans- 
form mode  since  each  pixel  must  be  read  out  repeatedly  to  produce  the  trans- 
form. Dark  current  levels  and  sensitivity  are  the  same  as  for  the  normal 
mode. 

Dynamic  range  measurements  in  the  transform  mode  were  hampered 
by  a problem  with  the  horizontal  scanners.  In  this  mode,  where  four  col- 
umns must  be  driven  simultaneously,  parasitic  coupling  to  the  scanner 
outputs  caused  it  to  malfunction.  Proper  operation  could  be  achieved  by  re- 
ducing the  drive  voltages,  but  this  resulted  in  a lower  dynamic  range.  Al- 
though performance  was  expected  to  improve  due  to  the  factor  of  5 reduction 
in  bandwidth,  the  limited  drive  capabilities  offset  this  advantage  and  the  dy- 
namic range  measurements  were  on  the  same  order  as  those  obtained  in  the 
normal  mode. 

This  scanner  inadequacy  can  be  corrected  by  a circuit  modification  in 
future  designs. 

i 

i 

I 
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(c)  Third  Pixel  Illuminated 


(a)  First  Pixel  Illuminated 


(d)  Fourth  Pixel  Illuminated 


(b)  Second  Pixel  Illuminated 


Figure  5-10,  Transform  Readout  Verification 


I 


6.0  SUMMARY  AND  CONCLUSIONS 

The  feasibility  of  real-time  transform  coding  of  an  optical  image  directly 
on  a CID  imager  has  been  conclusively  demonstrated.  In  addition,  picture 
quality,  in  terms  of  thermal  and  fixed-pattern  noise,  MTF,  and  spectral  re- 
sponse characteristics,  is  excellent.  Two  minor  design  deficiencies,  not  un- 
common in  new  imager  designs,  were  but  a minor  hindrance  in  characterizing 
device  performance.  These  errors  will  be  corrected  in  future  designs. 

The  falloff  in  response  at  the  shorter  wavelengths,  while  expected  from 
the  two-level  polysilicon  structure,  is  nevertheless  disappointing.  Fortu- 
nately, the  advent  of  transparent,  metal-oxide  electrode  materials  promises 
a dramatic  improvement  in  the  blue-green  response  of  future  devices. 

Resolution  of  the  present  device  is  unlikely  to  be  sufficient  for  a large 
number  of  potential  applications;  however,  the  design,  with  its  30  p-square 
sensing  site  size,  can  be  relatively  easily  expanded  to  higher  resolution  -- 
to  256  X 256  and  higher.  \ 

This  development  is  considered  to  be  an  important  first  step  towards  the  i 

realization  of  miniature,  low  power,  bandwidth-compression,  (jam -resistant) 
systems  suitable  for  mini-RPV  applications.  Other  potential  applications  are 
in  video-guided  weapons  and  cannon-launched  guided  projectiles  (smart 
bombs). 

A scientific  imaging  application  might  be  in  Hadamard-transform  spectros- 
copy, where  the  elimination  of  cumbersome  optical  masks  woiild  result  in 
significant  system  simplifications. 

Two  areas  in  which  future  development  is  required  are: 

(a)  increased  resolution  through  the  design,  fabrication,  and  evaluation 
of  arrays  of  the  order  2 56  x 2 56. 

(b)  evaluation  of  total  systems  performance  of  a bandwidth- compression 
system  incorporating  such  a CID  array,  including  assembly  of  a 
demonstration  system. 
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APPENDIX  A 


1.  SCANNER  DESCRIPTION 

As  described  in  the  text,  selection  of  individual  subgroups  is  effected  by 
means  of  two  serial  shift  registers  fabricated  along  one  horizontal  and  one 
vertical  axis  of  the  array.  This  particular  design  was  developed  for  use 
on  high-speed,  high-density  CID  arrays  and  for  this  reason  has  some  unique 
characteristics  not  foimd  in  the  more  normal  type  of  MOS  shift  register. 

An  important  observation  can  be  made  on  the  nature  of  the  shift  regis-  ; 

ters  required  in  this  application.  As  every  line  (row  or  column)  must  be 
addressed  just  once  between  consecutive  initializations  of  the  shift  registers, 
it  follows  that  a signal  "one"  is  always  trailed  by  a series  of  logic  "zero" 
levels;  more  appropriately,  therefore,  we  shotild  call  this  circuit  element  a 
scanner  instead  of  a shift  register. 

For  this  reason  we  can  simplify  the  design  of  the  scanner  as  we  can 
impose  without  penalty  on  performance  that  each  stage  of  the  scanner  follow- 
ing a logic  level  "one"  be  set  at  a logic  level  "zero."  Furthermore,  by 
designing  this  scanner  with  noninverting  stages,  the  number  of  parallel  out-  i 

puts  doubles  in  comparison  to  a similar  register  made  with  inverting  stages. 

This  is  due  to  the  fact  that  an  output  can  be  tapped  only  once  for  every  pair 

of  inverters,  because  the  signal  and  its  complement  must  be  held  at  every 

stage.  i 

A main  concern  in  the  design  of  a scanner  is  the  regeneration  of  the  i 

signal  at  every  stage  for  avoiding  signal  losses  in  the  transfers,  particularly  j 

those  due  to  gate  threshold  drops.  This  problem  is  overcome  with  the  intro-  j 

duction  of  bootstrapping  in  the  form  of  a MOS  varactor  capacitor,  which  has  j 

the  desirable  property  of  being  active  only  in  presence  of  a signal  "one."  ! 

Thus  a noise  rejection  mechanism  is  inserted  in  this  scanner  as  the  signal  I 

is  transmitted  and  amplified  only  if  it  is  above  the  gate  threshold  value.  j 

This  scanner  is  clocked  by  two  phase  lines  with  the  clock  pulses  alter-  \ 

natively  fed  to  one  or  the  other  of  the  two  lines.  At  any  time  there  is  i 

always  a phase  line  at  ground  level,  making  a separate  ground  bus  line  un-  ! 

necessary.  ' 

The  scanner  circuit  diagram  is  shown  in  Figure  A-1.  Four  MOS  tran- 
sistors are  the  active  elements  of  each  stage.  Two  of  them,  called  Ti  and 
T3,  have  large  aspect  ratios,  because  their  purpose  is  to  transfer  the  phase 
line  clock  pulse  with  the  smallest  delay  to  the  next  stage  when  the  preceding 
stage  is  at  logic  level  "one."  Specifically,  the  gate  of  Ti  is  connected  to  the 
gate  of  the  bootstrapped  MOS  varactor  T4,  which  can  thus  rise  above  the 
phase  line  voltage  and  transfer  without  threshold  losses  and  at  high  speed 
the  clock  pulse  through  Ti.  For  achieving  a significant  bootstrapping  action 
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Figure  A-1.  Scanner  Circuit  Diagram 

the  combined  gate  capacitance  of  T4  and  Ti  should  be  large  in  comparison  to 
the  other  capacitances  associated  with  the  same  node,  but  coupled  to  the  sub- 
strate (ground),  like  Ci  and  Cgg.  As  the  design  of  Ti  is  largely  dictated  by 
the  selection  of  an  appropriate  transconductance  value,  the  main  bootstrapping 
capacitance  is  provided  by  T4  which  is  laid  out  as  a large  area  device  with  as- 
pect ratio  close  to  one  and  with  source  and  drain  tied  together.  As  T4  acts 
like  a charge  reservoir,  the  square  geometry  provides  an  optimum  charge 
access  to  the  output  port  allowing  shorter  time  delays  in  charging  and  dis- 
charging. 

Transistor  T3  is  connected  in  a diode  configuration  with  the  gate  and  the 
drain  tied  together.  As  a result  it  allows  the  charging  of  node  5 to  take  place, 
but  it  cuts  off  the  discharge  path,  electrically  isolating  this  node  during  the 
fall  off  of  the  phase  pulse  5i. 

Finally,  transistor  T2  provides  a discharge  path  for  the  bootstrapping 
capacitance  bringing  the  gate  voltage  of  T4  and  Ti  to  ground  after  the  charg- 
ing of  node  5 has  taken  place.  Tliis  transistor  should  be  designed  with  min- 
imum geometry,  because  it  is  turned  on  after  node  5 has  been  electrically 
isolated  during  the  falloff  of  the  phase  pulse  and  therefore  reduces  the 
bootstrapping  action  of  T8  by  coupling  node  5 to  the  ground. 

Tlie  aspect  ratio  of  transistor  Tg  should  also  be  small  in  comparison  to 
that  of  Ti  for  assuring  that  Ti  completes  the  discharge  of  node  4 before  it  is 
turned  off  by  the  simultaneous  discharge  of  node  3 through  T2.  In  practice, 

T2  is  designed  with  an  aspect  ratio  of  1,  while  Ti  and  T3  have  approximately 
an  aspect  ratio  of  6 to  establish  a safe  margin  in  the  time  constants  ratio. 

As  we  refer  to  p-channel  devices,  let  us  consider  that  in  the  initial  con- 
dition the  input  voltage  V3  is  negative  and  equal  to  Vq  which  is  equivalent  to  a 
logic  level  "one."  As  a result  transistor  T4  is  "on"  determining  a strong 
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capiicitive  coupling  between  the  input  phase  line  §i.  This  coupling  is  due  to 
the  formation  of  an  inversion  layer  beneath  the  gate  of  T4,  which  can  be  inter- 
preted as  an  extension  of  the  source  and  drain  regions  in  the  computation  of 
the  gate-source  (drain)  capacitance. 

As  the  phase  line  $1  is  pulsed  from  0 to  V the  large  capacitance  of  T4 
overrides  the  capacitance  to  ground  Ci  and  bootstraps  V3  to  V^g  which  must 
be  larger  than  V 5 for  a complete  transmission  of  pulse  $1  through  transistor 
T1  without  threshold  losses.  The  harder  T1  is  turned  "on,"  the  shorter  is 
the  lag  in  the  rise  time  of  pulse  at  node  4.  Transistor  T3  is  connected  in 
a diode  equivalent  configuration  between  nodes  4 and  5 and  is  "on"  when  V4 
is  more  negative  than  V5  by  at  least  a threshold  voltage,  Vrp. 

Thus  under  the  influence  of  pulse  ?i  transistor  T3  conducts  and  draws 
current  from  node  4 for  charging  C3  and  the  gate  to  source  (drain)  capaci- 
tances of  T5  and  Ts.  It  will  eventually  stop  conduction  when  V5  equals 
(V5  - Vt),  assuming  that  the  gate  of  T3  is  at  V 5. 

Transistor  T2  is  turned  off  during  the  pulse,  because  even  when  the 
gate  is  at  the  peak  voltage  (V^  - Vrp),  this  voltage  is  still  less  than  the  source 
and  drain  voltages,  and  Vqs  respectively.  T]ius  any  current  drain  is  pre- 
cluded from  node  3,  and  the  bootstrap  voltage  remains  constantly  applied  to 
the  gate  of  Ti  until  the  pulse  ends. 

When  the  phase  line  ?i  falls  back  to  zero,  transistor  T3  is  turned  off 
immediately,  letting  the  voltage  at  node  5 to  reach  its  equilibrium  value 
as  a result  of  charge  redistribution  between  C3  and  the  capacitances  of  tran- 
sistors T2,  Ts,  Tg,  and  in  smaller  degree,  of  T3.  Simultaneously,  V3  is 
brought  back  to  its  initial  voltage,  Vq,  as  the  bootstrapping  action  of  T4  now 
occurs  in  reverse,  and  from  this  level  V3  falls  rapidly  to  zero  as  the  charge 
at  node  3 drains  through  T2,  which  is  now  "on." 

The  voltage  at  node  4,  V4,  is  also  decreasing  rapidly  to  zero  as  C2  and 
the  capacitance  of  T3  are  discharged  through  transistor  Ti  to  phase  5i,  which 
is  now  zero.  Caution  must  be  excercised  in  the  scanner  design  to  ensure  that 
V3  does  not  fall  to  zero  faster  than  V4.  because  as  soon  as  V3  is  within  a 
threshold  drop  from  ?i,  Ti  is  turned  "off"  freezing  the  residual  voltage  V4. 
This  problem  is  avoided  by  choosing  a much  larger  aspect  ratio  for  Ti  than 
for  T2  and  by  keeping  C2  reasonably  small. 

When  tlie  phase  pulse  $2  starts,  the  bootstrapping  action  raises  V5  from 
Vq  to  Vj3s,  repeating  the  cycle  already  described  for  V3  and  pulse  §1. 

For  completeness,  let  us  consider  the  case  where  in  the  initial  condition 
V3  is  below  threshold,  corresponding  to  a logic  level  "zero."  As  transistor 
T4  is  then  turned  "off,"  the  bootstrapping  action  does  not  occur  in  presence 
of  pulse  ?]  and  coupling  between  node  3 and  ground  through  Ci  prevails  in 
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keeping  V3  below  threshold  so  that  transistor  Ti  remains  "off"  and  no  voltage 
chcinge  occurs  in  the  following  stages  of  the  scanner. 

Examining  the  timing  diagram.  Figure  A-2,  we  observe  the  existence  of 
two  types  of  pulses,  which  can  be  used  as  outputs  on  a capacitive  load  --  for 
example,  the  gate  of  a decoder  transistor.  This  feature  adds  considerable 
flexibility  to  this  scanner,  because  in  some  applications  it  is  preferable  to 
have  output  pulses  at  adjacent  locations  which  are  slightly  overlapping  in 
time,  likeVa,  V5,  and  V7,  while  in  other  cases  a complete  extenction  of  a pulse  is 
required  before  the  next  pulse  starts  at  the  following  output,  like  V4  and  Vg. 

This  design  has  been  thoroughly  evaluated,  both  analytically  and  by  means 
of  various  computer-aided  transient  analysis  programs,  (such  as  SCEPTRE), 
and  is  used  in  a number  of  operational  CID  imagers.  The  particular  design 
used  in  the  subject  array  was  fully  evaluated  and  its  performance''  verified 
for  the  application. 


Figure  A-2.  Scanner  Timing  Diagram 
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APPENDIX  B 


ARRAY  OUTPUT  CAPACITANCE 

Tlie  capacitive  load  presented  to  the  signal  charge  and  any  on-chip  voltage 
attenuation  must  be  known  to  determine  array  performance  factors  such  as 
quantum  efficiency,  dark  current  density  and  noise  equivalent  signal.  The 
array  schematic  diagram.  Figure  R-1,  illustrates  tlie  on-chip  circuitry  used 
to  connect  four  array  rows  to  the  on-chip  MOS-FET  source  followers.  A 
single  logical  "ONE"  is  transferred  along  the  vertical  scanner  to  sequentially 
select  the  array  rows  in  groups  of  four.  Tlie  selected  group  of  four  rows  is 
connected  to  four  source  follower  IMOS-FET  gates  providing  that  the  dis- 
connect gate  (DC)  is  energized.  Tlie  injection  gate  (IG)  is  off  during  array 
readout.  A compensation  line  (C)  has  been  added  to  the  array  to  provide  for 
cancellation  of  the  capacitively  coupled  column  drive  voltage  interference. 

This  compensation  line  is  selected  by  a logical  "OR"  of  the  vertical  phase 
drive  voltages  so  that  it  is  active  for  all  array  readout  operations.  The  com- 
pensation signal  bus  line  was  located  inboard  of  the  row  signal  bus  linos  to 
insure  that  the  compensation  bus  would  have  a distributed  capacitance  that 
was  similar  to  the  active  row  signal  bus  capacitance.  The  cross-coupling 
between  the  signal  lines  and  the  compensation  line  that  was  introduced  by  this 
choice  of  compensation  bus  location  resulted  in  signal  attenuation  prior  to  on- 
chip  amplification.  It  resulted  in  a significant  loss  in  dynamic  range,  approx- 
imately 2:1,  and  a small  amount  of  crosstalk  between  the  four  array  rows 
being  read  out.  Tliese  problems  can  be  effectively  eliminated  in  future  array 
designs  by  a simple  topological  layout  change.  Tlie  magnitude  of  the  on-chip 
capacitance  and  voltage  attenuation  was  measured  to  allow  characterization 
of  chip  parameters. 

The  equivalent  circuit  of  the  row  selection  network  is  shown  in  Figure 
B-2.  One  packaged  imager  was  biased  in  the  normal  manner  and  the  magni- 
tude of  the  capacitance  components  was  determined  as  follows: 

1.  The  capacitance  of  all  array  rows  was  measured  at  terminal  RVD. 

The  individual  row  capacitance,  Cj:^,  was  found  to  be  Cj:^  = Cpjyj^/l28 
= 6.  0 pF. 

2.  Tlie  sum  of  the  four  signal  and  compensation  bus  line  capacitance, 
including  the  gate  input  capacitance  of  the  on-chip  source  followers 
was  measured  at  terminal  ID. 

Cc  ‘ 4Cs  = 21.  8 pF 


3. 


Tlie  capacitance,  looking  into  the  compensation  line,  was  measured 
through  terminal  C.  . 


^measured  = Cc  + 4 


CxCs 

Cx+Cs 


= 7.  3 pF 


4. 


The  ratio  of  crossover  capacitance,  Cx,  to  signal  bus  capacitance, 
Cs,  was  measured  by  capacitively  coupling  a small  voltage  pulse  into 


GO 


Cc  =COMPENSATION  BUS  LINE  CAPACITANCE 
Cx  =CROSS-OVER  CAPACITANCE 

Figure  B-2.  Row  Selection  Network  Equivalent  Circuit 

terminal  C and  measuring  the  ratio  of  source  follower  output  01  to 
outputs  02  through  05.  Tlie  circuit  was  maintained  at  normal  bias 
voltage  during  this  measurement  by  periodically  pulsing  IG  while 
maintaining  ID  at  the  row  bias  voltage.  The  measured  ratio  of  out- 
put 01  to  02  through  05  was  3 to  0.  8 for  all  four  signal  outputs. 
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From  this  data  the  array  capacitive  components  was  found  to  be 

Cj^  = 6.  0 pF 
Cg  = 4.  9 pF 
Cq  = 2,  0 pF 
= 1.  8 pF 

A source  follower  voltage  gain  of  0.  82  was  also  measured  under  these 
conditions. 


When  an  area  of  the  array  is  illuminated  uniformly,  all  four  signal  bus 
lines  will  have  the  same  video  voltage  and  the  cross-coupling  capacitance  be- 
tween signal  lines  will  not  act  as  load  capacitance.  Signal  voltage  is  coupled 
from  all  four  signal  bus  lines  to  the  compensation  line  resulting  in  a fraction 
of  the  signal  voltage  appearing  on  the  compensation  line.  Under  this  condition, 
the  compensation  line  voltage  is: 


Vc  = Vs 


4C. 


Cr+Co+4Cx 


= .48  Vs 


Since  the  compensation  line  voltage  is  subtracted  from  the  four  signal  line 
outputs,  the  effect  of  this  cross -coupling  is  to  attenuate  the  signal  by  approx- 
imately two  to  one.  The  total  on-chip  gain,  including  the  source  follower,  is 


rVg-Vc> 


X Source  follower  gain 


'Vs-,48  Vg^ 


X .82  = . 43 


The  loading  effect  on  the  cross-coupling  capacitance  from  one  signal  line 
to  the  compensation  line  is: 

Cx(l  -^)  = 0.9pF 

The  total  load  capacitance  under  uniform  illiunination  conditions  is: 

/ \ 

V, 


ClOAD  Cr  -h  Cs  + Cx 
= 11.  9 pF 


Under  point  source  illumination  conditions  the  cross-coupling  capacitance 
between  signal  bus  lines  does  load  the  signal  charge.  The  equivalent  circuit 
for  one  signal  bus  is  shown  in  Figure  B-3(a).  This  equivalent  circuit  has  been 
simplified  by  applying  a Y - A transformation.  The  result  is  shown  in 
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Figure  B-3(b).  Substitution  of  the  measured  capacitance  values  results  in  the 
following  load  capacitance  and  gain  factors. 


Signal  Load  Capacitance,  Cg  = 17.  1 pF 
Signal  on  Compensation  Line,  Vf.  = . 17  Vg 
/Vs-^Vc\ 

GAIN  = I — r: — ^1  X Source  Follower  Gain  = . 68 


V, 
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BUS 
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Cy  dr 
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3C. 


3(Cr+Cs) 
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(a)  Capacitive  Loading  & Cross-Coupling 


SIGNAL 

BUS 


3Cv{Cr  + C<.) 


- 2Cx+Cr  + C 


X,  1,  1 

^ Cr  ^Cc  -p 


2Cx  + Cp  +C5 


3Cx  ( Cp  + C5  ) 


- 2Cx  + Cp  + Cs 

(b)  Simplified  Circuit 


COMPENSATION 
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Figure  B-3.  On  Chip  Equivalent  Circuit  - Point  Illumination 
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